-- Logs begin at Wed 2022-08-24 17:27:45 UTC, end at Wed 2022-08-24 18:41:01 UTC. -- Aug 24 18:00:39.875152 dv-cinder-840525-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 18:00:39.885218 dv-cinder-840525-3-smb devstack@keystone.service[81871]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 18:00:39.887851 dv-cinder-840525-3-smb devstack@keystone.service[81871]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 18:00:39 2022] *** Aug 24 18:00:39.887990 dv-cinder-840525-3-smb devstack@keystone.service[81871]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 18:00:39.888105 dv-cinder-840525-3-smb devstack@keystone.service[81871]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 18:00:39.888209 dv-cinder-840525-3-smb devstack@keystone.service[81871]: nodename: dv-cinder-840525-3-smb Aug 24 18:00:39.888311 dv-cinder-840525-3-smb devstack@keystone.service[81871]: machine: x86_64 Aug 24 18:00:39.888414 dv-cinder-840525-3-smb devstack@keystone.service[81871]: clock source: unix Aug 24 18:00:39.888515 dv-cinder-840525-3-smb devstack@keystone.service[81871]: pcre jit disabled Aug 24 18:00:39.888617 dv-cinder-840525-3-smb devstack@keystone.service[81871]: detected number of CPU cores: 4 Aug 24 18:00:39.888729 dv-cinder-840525-3-smb devstack@keystone.service[81871]: current working directory: / Aug 24 18:00:39.888832 dv-cinder-840525-3-smb devstack@keystone.service[81871]: detected binary path: /usr/bin/uwsgi-core Aug 24 18:00:39.888971 dv-cinder-840525-3-smb devstack@keystone.service[81871]: your processes number limit is 47680 Aug 24 18:00:39.889081 dv-cinder-840525-3-smb devstack@keystone.service[81871]: your memory page size is 4096 bytes Aug 24 18:00:39.889188 dv-cinder-840525-3-smb devstack@keystone.service[81871]: detected max file descriptor number: 2048 Aug 24 18:00:39.889294 dv-cinder-840525-3-smb devstack@keystone.service[81871]: lock engine: pthread robust mutexes Aug 24 18:00:39.889552 dv-cinder-840525-3-smb devstack@keystone.service[81871]: thunder lock: enabled Aug 24 18:00:39.889847 dv-cinder-840525-3-smb devstack@keystone.service[81871]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 18:00:39.890028 dv-cinder-840525-3-smb devstack@keystone.service[81871]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 18:00:39.930455 dv-cinder-840525-3-smb devstack@keystone.service[81871]: Python main interpreter initialized at 0x55b9266a49c0 Aug 24 18:00:39.930455 dv-cinder-840525-3-smb devstack@keystone.service[81871]: python threads support enabled Aug 24 18:00:39.930455 dv-cinder-840525-3-smb devstack@keystone.service[81871]: your server socket listen backlog is limited to 100 connections Aug 24 18:00:39.930455 dv-cinder-840525-3-smb devstack@keystone.service[81871]: your mercy for graceful operations on workers is 90 seconds Aug 24 18:00:39.930840 dv-cinder-840525-3-smb devstack@keystone.service[81871]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 18:00:39.930923 dv-cinder-840525-3-smb devstack@keystone.service[81871]: *** Operational MODE: preforking *** Aug 24 18:00:39.931170 dv-cinder-840525-3-smb devstack@keystone.service[81871]: *** uWSGI is running in multiple interpreter mode *** Aug 24 18:00:39.931170 dv-cinder-840525-3-smb devstack@keystone.service[81871]: spawned uWSGI master process (pid: 81871) Aug 24 18:00:39.931381 dv-cinder-840525-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 18:00:39.933250 dv-cinder-840525-3-smb devstack@keystone.service[81871]: spawned uWSGI worker 1 (pid: 81883, cores: 1) Aug 24 18:00:39.933250 dv-cinder-840525-3-smb devstack@keystone.service[81871]: spawned uWSGI worker 2 (pid: 81884, cores: 1) Aug 24 18:00:39.933250 dv-cinder-840525-3-smb devstack@keystone.service[81871]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 18:00:44.260170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 18:00:44.260170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 24 18:00:44.260910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 18:00:44.260910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 24 18:00:44.261606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 18:00:44.261606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: from cryptography.utils import int_from_bytes Aug 24 18:00:44.262076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 18:00:44.262076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: from cryptography.utils import int_from_bytes Aug 24 18:00:44.311683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 18:00:44.311902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 18:00:44.312075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] command line args: [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 18:00:44.312352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 18:00:44.312528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ================================================================================ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 18:00:44.312780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.313025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_dir = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.313211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.313291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 18:00:44.313391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_source = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.313475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 18:00:44.313568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] debug = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.313656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] command line args: [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 18:00:44.313766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 18:00:44.314024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ================================================================================ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 18:00:44.314138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] admin_token = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_dir = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] config_source = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.314966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] debug = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_config_append = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_dir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.315931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_config_append = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.316983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_dir = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.317967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.318863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] publish_errors = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.319967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.320866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] publish_errors = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] standard_threads = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.321859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_journal = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_json = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_stderr = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] standard_threads = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_syslog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.322894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.322991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.323067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_journal = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.323229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_json = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.323305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.323401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_stderr = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.323477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.323575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] use_syslog = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.323710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.323899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 18:00:44.323976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.324947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.325923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.326002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.326170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.326803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.327938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.328944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.329995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.330932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.331918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.332989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.333964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.334899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.335967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.336963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.337920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.338971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.339945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.340965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.341943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.342542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.342887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.342964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.343820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.345930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.346943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.347508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.348988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.349945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.external = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.350833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.external = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.password = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.352962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.token = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.password = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] auth.token = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.353962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.354934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.355977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.356859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.357975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358770 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.358862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.359916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.360981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.361939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.362974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.363952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.364981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.365916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.366931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.367935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.368999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.369964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.370875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.371970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.372050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.372220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.372352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.375866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.376880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.377984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.378920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.379906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.380948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.381886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.382963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.383898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.384954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.385994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.386928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.387973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.388667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.389881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.390990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.391943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.392850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.393794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.394932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.395893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.396801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.397965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.398927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.399911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.400011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.400109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.400204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.400300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.405936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.406996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.407573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 18:00:44.407646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.412179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.412482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.412742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.413010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.413268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 18:00:44.413453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 18:00:44.444825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.445057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.445280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.447382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.447619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.447875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.454525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.457446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.483605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.483859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.486322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.486515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.542406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.544348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.607164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.607395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.608757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.609003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.776942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.777064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.777158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.777298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.804690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.804826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.804914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.805973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.806094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.817852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.818613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.834879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.835504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 18:00:44.852197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.852404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 18:00:44.852602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.853008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.853151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 18:00:44.853407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 18:00:44.853504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.853573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.853635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 18:00:44.853802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.853896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.854147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.854307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.854576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.854659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.854906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.864823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.865953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.872625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.873809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.876328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.876613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.876721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.876893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.876980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.877804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.878987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.879134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.879253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.879411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.879681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.902348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.902615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.903812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.904089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.904175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.904416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.908968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.909273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.909517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.909606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.909803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.910086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.915921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.916207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.916510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.916811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.920967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.921355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.921532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.921642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.921822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.921906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.922962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.923044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.923229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.923497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.941067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.942307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.942410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.942410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.945241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.946110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.948471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.948820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.949475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.949768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.953187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.954118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.956385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.957249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.959584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.959935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.960223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.960508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.960592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.960790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.960875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.961077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.961170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.961374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.961661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.961950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.977277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.977568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.978100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.978361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.978533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.978838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.979108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.979367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.985971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.986839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.987491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.987777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.988366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.988641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.990522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.990805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.991095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.991313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:44.991398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.991598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.991683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.991912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.992347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:44.992629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.002984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.003266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.003570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.003881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.004284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.004373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.004613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.004700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.004893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.004983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.005169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.005514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.005794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.006098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.021490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.022431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.024497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.025465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.028282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.028407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.028853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.030389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.030972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.031254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.031551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.031868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.032160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.032490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.038161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.038922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.039607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.040386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.042682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.042971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.043279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.043398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.043560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.043696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.044028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.044316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.051695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.053806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.053806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.053955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.053955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.053955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.059173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.059458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.059740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.060044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.060267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 18:00:45.060354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.060637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.060731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.060924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.061831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.062881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.063069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.063330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.063607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.063902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 18:00:45.098445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9266a49c0 pid: 81884 (default app) Aug 24 18:00:45.100799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9266a49c0 pid: 81883 (default app) Aug 24 18:00:45.102552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966fecc-1f81-470d-9e3a-e222a71d9276 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:45.103103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966fecc-1f81-470d-9e3a-e222a71d9276 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:45.103370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966fecc-1f81-470d-9e3a-e222a71d9276 None None] PATH_INFO: `/v3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:45.107853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Aug 24 18:00:45 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:00:52.755180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:52.755697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:52.755801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:52.760099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:00:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:00:52.767676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:52.768102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:52.768261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:52.846742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: INFO dbcounter [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] Registered counter for database keystone Aug 24 18:00:52.865709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG oslo_db.sqlalchemy.engines [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 18:00:52.871925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writer thread running {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 18:00:53.054176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG passlib.handlers.bcrypt [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81884) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 18:00:53.054525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG passlib.handlers.bcrypt [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81884) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 18:00:53.109147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:00:53.110726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:00:53.238612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:00:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 18:00:53.673375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:53.740393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: INFO dbcounter [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] Registered counter for database keystone Aug 24 18:00:53.761503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG oslo_db.sqlalchemy.engines [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 18:00:53.768289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writer thread running {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 18:00:53.885821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365276e-669d-47aa-bab7-20b1cefd286c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:53.890584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:53.891202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:53.891478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:53.891747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:53.899742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:53.950829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING keystone.common.rbac_enforcer.enforcer [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 18:00:53.951901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78762b9a-4595-4f2a-88a1-e17f295eab64 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:53.961356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 24 18:00:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:53.967996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:53.982827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3880bcf-a594-4b68-8ece-a46f8839bd6b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:53.987388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:53.988521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:53.988803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:53.989073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] PATH_INFO: `/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:53.990647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] RBAC: Authorizing `identity:get_project(project_id=2824d75c5b514c0dacffd09ee4e2eb05)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:54.043341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 18:00:54.043687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e131a19-563d-417c-b924-aebef5aa6205 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:54.048289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Aug 24 18:00:53 2022] GET /identity/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:00:55.928303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a93c-2e54-4862-9f38-eba3b1e405f5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:55.928894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a93c-2e54-4862-9f38-eba3b1e405f5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:55.928894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6a93c-2e54-4862-9f38-eba3b1e405f5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:55.932924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:00:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:00:55.939021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:55.939435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:55.939572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:55.959965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:00:55.961479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:00:55.969295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:00:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 18:00:56.237514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6a93c-2e54-4862-9f38-eba3b1e405f5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:56.249639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6a93c-2e54-4862-9f38-eba3b1e405f5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:56.253830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:56.254434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:56.254711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:56.254986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:56.262709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:56.265261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef85720-9dd1-43f6-b5cf-6ba8fb4dff17 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:56.273989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 24 18:00:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:56.279953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:56.289026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8019a-5c91-447c-b367-20c280314f42 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:56.293339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:56.293952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:56.294228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:56.294496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:56.295968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:56.297789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5d487-f4e4-41d5-8fef-61fea8ea5615 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:56.299282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Aug 24 18:00:56 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:00:58.273230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ade77-6dbd-4244-bd0a-2fe74c6129eb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.273748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ade77-6dbd-4244-bd0a-2fe74c6129eb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.273748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ade77-6dbd-4244-bd0a-2fe74c6129eb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.275078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:00:58.280310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.280744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.280847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.299379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:00:58.300589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:00:58.311391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c5a0d-4d47-4eb7-972b-1270dd2d5305 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.311668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c5a0d-4d47-4eb7-972b-1270dd2d5305 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.311975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c5a0d-4d47-4eb7-972b-1270dd2d5305 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.313442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:00:58.318063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.318339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.318609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.360451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81883) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 18:00:58.360863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81883) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 18:00:58.380538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:00:58.406898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:00:58.408532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:00:58.506694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:00:58.652547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:58.677097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:58.757121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3552c-9d68-4343-b1b3-60ac2a737bbe None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:58.772083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:58.791685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:58.792353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.792633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.792914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.806260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:00:58.815113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:00:58.816261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:00:58.817277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:00:58.821949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:58.878654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b413c-7cd3-4e5a-baf2-7e0c1e70e535 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:58.881085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:58.901676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:58.916265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:58.917115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.917401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.917666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.920114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb22ee1-9e88-4294-bf3c-c3978423e355 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:58.954472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:58.955334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:58.956032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:58.956303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:58.956964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:00:58.957262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:58.958670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:58.970645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:00:58.976122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:58.985861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:58.987387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.074318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e46a-653a-4308-b8db-7b8e790c16b0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:59.083179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:00:59.088698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:59.091414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:59.109264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:59.109897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:59.110181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:59.110456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:59.111613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:59.113099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.114676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:00:58 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:00:59.120011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:59.135453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:59.195635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cc53b-d789-4b3d-97ac-ae3579b024f2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:59.225129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5367-6608-4a60-99e0-d048e2a9b2dd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:59.229994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:59.230883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:59.231165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:59.231434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:59.252421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:59.253991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.262627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:59.264052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:59.264331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:59.264598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:59.265731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:59.267177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.268954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:00:59.272536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:00:59.273874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:00:59.274651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:00:59.274651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:00:59.274651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:00:59.274651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:00:59.274851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:59.280079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:00:59.336491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:59.354489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:00:59.372778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4edbe-68de-4aaa-9cb2-4cc8a612d0ed None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:59.380285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1adbef-52b3-4663-a119-7957daed1dce None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:00:59.407572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:59.408739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:59.409018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:59.409292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:59.410015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.domain.id=default, user.id=57b1eaab77b840f39d5eb6bd620e915e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:00:59.410321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:59.411785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190da6f5-eb4c-418a-94d9-8c071cfa26fa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.414864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:00:59.415469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:00:59.415766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:00:59.416051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:00:59.416695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:00:59.416999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:00:59.418382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eed94-9474-4b1a-b1a3-f4e69a0ecfaf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:00:59.418468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 24 18:00:59 2022] GET /identity/v3/role_assignments?user.id=57b1eaab77b840f39d5eb6bd620e915e&scope.domain.id=default&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:00:59.438490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:01.420615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08f521-243b-4175-9e0e-34ee32a6574f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:01.421787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08f521-243b-4175-9e0e-34ee32a6574f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:01.422286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08f521-243b-4175-9e0e-34ee32a6574f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:01.423854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:01.440851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6781e-64e8-400e-a453-49c54bded77c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:01.441364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6781e-64e8-400e-a453-49c54bded77c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:01.441364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6781e-64e8-400e-a453-49c54bded77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:01.468934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-83d6781e-64e8-400e-a453-49c54bded77c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:01.470184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83d6781e-64e8-400e-a453-49c54bded77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:01.557979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:01.753458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de0c1-c752-45da-a1e7-9a409afa7f67 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:01.754118 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de0c1-c752-45da-a1e7-9a409afa7f67 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:01.754699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de0c1-c752-45da-a1e7-9a409afa7f67 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:01.756265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:01.765879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:01.766158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:01.766435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:01.792806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:01.794023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:01.849746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:01.879548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 12/25] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:02.096832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1abd-b422-4dcf-8a23-c32c0585244d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.097495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1abd-b422-4dcf-8a23-c32c0585244d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.097973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1abd-b422-4dcf-8a23-c32c0585244d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.099551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 14/26] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:02.101904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:02.108477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.109014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.109478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.132081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:02.133569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:02.288398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 15/27] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:02.331590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b4729-387c-4774-b2dd-23b81a2371df None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:02.390329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:02.390898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.391176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.391448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.402834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:02.408078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:02.419044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:02.419992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:02.420731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 13/28] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:02.426583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:02.532491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:02.546974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:02.570676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16006177-53f8-4974-82ac-356fbe6b8c25 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:02.619804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:02.620446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.620720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.620988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.637550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:02.639630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e801203a-d0ca-4884-82fe-5abe5ac077a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:01:02.655637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:02.656534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:01:02.657332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:01:02.657332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:01:02.657332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:02.657332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 16/29] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:02.658354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8c70-af9b-4d0c-badc-f5ebedf52fbd None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.658635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8c70-af9b-4d0c-badc-f5ebedf52fbd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.658909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba8c70-af9b-4d0c-badc-f5ebedf52fbd None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.660159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 17/30] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:02.660900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8c70-af9b-4d0c-badc-f5ebedf52fbd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:02.670660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d98298-c258-40f9-aff2-553e04a05612 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:02.712677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:02.713388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.713735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.714007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.714717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:02.715021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:02.716775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:02.729996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 14/31] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:02.735437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:02.776244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba8c70-af9b-4d0c-badc-f5ebedf52fbd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:02.804795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:02.815135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:02.815819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.817013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.817013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.817322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:02.818670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:02.855050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:02.860014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534fdf-517c-425d-b7b4-802f229a4ef3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:02.895211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:02.895848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.896128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.896394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.897029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:02.897324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:02.898872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ff57-1072-4514-b283-8afb7c7238bd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:02.911266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 15/32] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:02.912497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:02.912779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:02.913050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:02.933732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:02.935948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:03.011779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 16/33] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:03.011779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.046878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 18/34] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 18:01:02 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:03.056970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.113916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:03.127811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2aad1-1c22-4685-8fd2-54b97766dc04 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:03.167099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:03.168098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.168565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.169018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.171411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:03.173141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f7008-2788-4a42-a7bc-2bbc5fe990b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:03.175490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 17/35] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:03 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:03.176948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371f24-3705-4007-b9c5-754719a8dd88 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.177413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371f24-3705-4007-b9c5-754719a8dd88 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.177857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371f24-3705-4007-b9c5-754719a8dd88 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.179211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:03.187580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.188169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.188611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.209452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:03.210978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:03.258194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3398d5e-63ae-4458-881f-8a3615d27bce None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:03.289044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 19/37] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:03.290235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.320532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:03.327906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.327906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.327906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.327906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:03.327906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:03.423037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:03.441819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc859e-8ebc-4f73-9d7f-afb28c0d3f92 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:03.451889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 19/38] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:01:03 2022] POST /identity/v3/projects => generated 301 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:03.451889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.485490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:03.486138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.486527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.486800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.488179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:03.490488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fda30-d88c-413a-816d-5db197de12d1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:03.493102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 20/39] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:03.494419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d86db-e16f-457d-9bee-772d089eb28a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.494787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d86db-e16f-457d-9bee-772d089eb28a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.495068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d86db-e16f-457d-9bee-772d089eb28a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.500631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 21/40] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:03.500631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d86db-e16f-457d-9bee-772d089eb28a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.508203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:03.592656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb60479-880c-4450-a4e9-30bd139f2e74 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:03.636179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d86db-e16f-457d-9bee-772d089eb28a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:03.645080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:03.646428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.646428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.646428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.646894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:03.648336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4c98e-e5e8-425d-8974-a5778c064408 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:03.674117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:03.674707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.674983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.675256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] PATH_INFO: `/v3/domains/default/users/57b1eaab77b840f39d5eb6bd620e915e/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.677450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57b1eaab77b840f39d5eb6bd620e915e, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:03.678886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:03.729186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 18:01:03 2022] POST /identity/v3/roles => generated 225 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:03.730524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:03.730814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:03.731092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:03.750460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:03.752111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:03.830451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:03.831550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:03.874456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:03.902479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Aug 24 18:01:03 2022] PUT /identity/v3/domains/default/users/57b1eaab77b840f39d5eb6bd620e915e/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:01:03.973775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6095b4-dac7-45c7-8b72-7d013a1cd465 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:04.013879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:04.014648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:04.014822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:04.015091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:04.015783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:04.017218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:04.085477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 18:01:03 2022] POST /identity/v3/roles => generated 223 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:04.125833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:04.144898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:04.244393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce792d3-52dc-4d9e-8da6-ad27d81e3a1a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:04.389971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:04.390609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:04.390885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:04.391154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:04.392350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:04.393998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c236d8-4b49-491e-a265-ed604dee81cf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:04.398591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 23/45] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:04.404236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:04.491432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:04.503426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93add9-c7aa-4105-8b53-bda7b83ccfcf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:04.535705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:04.536339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:04.536622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:04.536900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:04.537548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:04.538999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5bcd4-c2ce-471f-b30b-6a9544d32e80 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:04.726060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:01:04 2022] POST /identity/v3/projects => generated 312 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:05.924957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cadab-b78e-4c27-9ed4-503c81b43a49 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:05.926172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cadab-b78e-4c27-9ed4-503c81b43a49 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:05.926172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cadab-b78e-4c27-9ed4-503c81b43a49 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:05.927724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 24/47] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:05.936975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:05.937487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:05.937595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:05.958753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:05.960089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:06.024292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 24/48] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:06.303717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cadab-b78e-4c27-9ed4-503c81b43a49 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:06.386907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:06.406118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cadab-b78e-4c27-9ed4-503c81b43a49 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:06.440367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:06.441007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.441287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.441561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.451973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:06.456728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:06.457577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:06.458459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 25/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:06.463548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:06.531447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:06.562343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967932-97c2-4c3b-8d73-bbf635b1b244 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:06.598082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:06.598697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.598975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.599246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.599968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:06.600242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:06.601612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed17b7-f9bd-4fe7-ab17-370a52c3cd82 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:06.610445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 25/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:06.615973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:06.658144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfe2-d6db-46bc-aa55-a69e5db4a50c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.658431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfe2-d6db-46bc-aa55-a69e5db4a50c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.658714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfe2-d6db-46bc-aa55-a69e5db4a50c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.660084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 26/51] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:06.664917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.665206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.665486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.682979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:06.684209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:06.717632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e993-fe82-481b-9fa8-3d1346ea18e6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:06.750276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:06.750439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 27/52] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:06.750902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.751180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.751447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.752727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:06.754175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:06.755739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:06 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:06.761157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:06.819917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:06.857825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df922c2-8826-446a-8d63-b99877aa2577 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:06.890114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:06.890735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:06.891013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:06.891375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:06.892504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:06.893979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:06.895525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:06.901291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:06.915959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:07.005632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a625e6-af28-45ad-a497-5f6cb8f123d5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:07.021922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:07.040370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:07.040982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:07.041259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:07.041530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:07.042240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.domain.id=default, user.id=57b1eaab77b840f39d5eb6bd620e915e) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:07.042540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:07.044017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:07.051743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 24 18:01:06 2022] GET /identity/v3/role_assignments?user.id=57b1eaab77b840f39d5eb6bd620e915e&scope.domain.id=default&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:07.128076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e036c2-8999-4257-b392-3805d7aaccfc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:07.158225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:07.164523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:07.165170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:07.165451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:07.165731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:07.166872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:07.168497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b683ece-0b56-4dea-980e-e9bd24db9bc7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:07.170139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:07.176077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:07.261734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:07.285128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb42d0e-eaf0-4db2-893f-71026f4dd923 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:07.319673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:07.320282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:07.320561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:07.320831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:07.321475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:07.322928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0346a-ac5c-4177-939c-55dc72192c32 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:07.409725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 28/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 24 18:01:07 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:09.352505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbc93-72f6-499e-9736-da8811183ae9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:09.353283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbc93-72f6-499e-9736-da8811183ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:09.353283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbc93-72f6-499e-9736-da8811183ae9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:09.354644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:09.360494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:09.360908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:09.361046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:09.378717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:09.380275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:09.445826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:09.722166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfbc93-72f6-499e-9736-da8811183ae9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:09.824476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfbc93-72f6-499e-9736-da8811183ae9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:09.858018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:09.858696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:09.858944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:09.859220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:09.860365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:09.861830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4882-2b73-4e9a-94af-4de2e7c54ed2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:09.863387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:09.868907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:09.923104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:09.965112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c9f2-70cd-4267-b037-01f1d49d4a55 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:09.999123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:10.000132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:10.000412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:10.000685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:10.001312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:10.002766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733035e-e8c0-45d4-9cd1-45f840204a79 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:10.072635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:09 2022] POST /identity/v3/users => generated 275 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:13.100532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe472-dc88-435b-a32d-b6f13e8dd09c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.101044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe472-dc88-435b-a32d-b6f13e8dd09c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.101115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe472-dc88-435b-a32d-b6f13e8dd09c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.102541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:13.113085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.113571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.113759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.139560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:13.140831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:13.157401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d874c5-599d-4130-bc5b-042ab6b6d5d6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.157685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d874c5-599d-4130-bc5b-042ab6b6d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.157954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d874c5-599d-4130-bc5b-042ab6b6d5d6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.159530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 33/63] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:13.164958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1ffe-b71a-4f2d-bdd0-dd0e1942edc0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.165242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1ffe-b71a-4f2d-bdd0-dd0e1942edc0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.165523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1ffe-b71a-4f2d-bdd0-dd0e1942edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.190961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-472f1ffe-b71a-4f2d-bdd0-dd0e1942edc0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:13.192200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-472f1ffe-b71a-4f2d-bdd0-dd0e1942edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:13.271631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:13.300572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:13.315868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:13.577928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:13.613648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f0fb-6998-4844-a12b-8b6ee89df583 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.614288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f0fb-6998-4844-a12b-8b6ee89df583 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.614757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655f0fb-6998-4844-a12b-8b6ee89df583 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.616377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 35/66] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:13.628425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07017e1-b0bb-4734-96ac-cea81f00b664 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.628988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07017e1-b0bb-4734-96ac-cea81f00b664 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.629472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07017e1-b0bb-4734-96ac-cea81f00b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.656832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f07017e1-b0bb-4734-96ac-cea81f00b664 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:13.661253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f07017e1-b0bb-4734-96ac-cea81f00b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:13.665879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:13.731296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0331-bb5d-4dcd-a12a-02365a105f0d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:13.735741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 36/67] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:13.736842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687067f-ee80-4080-86f1-3a40cf7defcb None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.737128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687067f-ee80-4080-86f1-3a40cf7defcb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.737398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687067f-ee80-4080-86f1-3a40cf7defcb None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.738750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 37/68] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:13.743656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badc9-3b0e-45c7-9a99-2488a29d0e3f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.743960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badc9-3b0e-45c7-9a99-2488a29d0e3f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.744236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badc9-3b0e-45c7-9a99-2488a29d0e3f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.745543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 38/69] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:13.746104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72badc9-3b0e-45c7-9a99-2488a29d0e3f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:13.776290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:13.776920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.777194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.777462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.788176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a4f3fb6e-5b72-4661-b0b3-261abc841997 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:13.792831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:13.793682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:13.794512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 32/70] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:13.795789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da42d-a9bc-47b5-acc3-3729c05c6fcb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.796011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da42d-a9bc-47b5-acc3-3729c05c6fcb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.796285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6da42d-a9bc-47b5-acc3-3729c05c6fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.814456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1e6da42d-a9bc-47b5-acc3-3729c05c6fcb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:13.815642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e6da42d-a9bc-47b5-acc3-3729c05c6fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:13.863797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72badc9-3b0e-45c7-9a99-2488a29d0e3f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:13.888866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 33/71] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:13.892053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.892053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.892053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.893791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:13.905989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:13.906797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:13.912274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:13.912274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:13.920468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:13.921600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:13.922976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:13.926423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:13.927274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:13.928044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 39/72] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:13.929400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:13.958949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.010680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 34/73] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:14.011882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.041511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816895dd-c294-4bd4-9e87-70b88c169445 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.080719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.081437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.081724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.082102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.082778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:14.083082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.084510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.094556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 40/74] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.099831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.121685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afc31a-2497-495a-b41a-d9baadd93904 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.156846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.160006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.160623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.160902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.161173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.161842 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:14.162138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.163524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.172647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 35/75] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.173471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.204118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.214360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bdfc3-c389-49ac-aac8-b0f1e726e01e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.254341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.255030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.255318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.255593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.269141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:14.274446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:14.275282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 41/76] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:14.276793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.292901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e480a1-9510-4168-b9c2-62aaca9e2ada None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.328257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.328894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.329173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.329449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.343955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.345432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.347044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 36/77] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.347829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.380038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e96a7-19c8-42be-afa9-ae5d3b39eb11 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.388750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.413866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.414501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.414781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.415058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.416275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.417755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.420489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 42/78] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.425245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.434125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.452630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a685e7-bdbd-4abf-b2e3-e5ffd6658019 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.488722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.489360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.489644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.489917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.491051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.492542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.494119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 37/79] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.494881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.519571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc483bb6-c78a-414c-8649-5edf928f0b1d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.553427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.554032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.554317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.554591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.555255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:14.555556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.556973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.565234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 43/80] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:14.566028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.596411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8bae0-0f2e-4672-ac65-579c5c253edf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.605109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.629815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.630513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.630732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.631004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.640977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:14.646124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:14.647156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:14.647966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 38/81] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:14.648607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.662216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.668761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c695-42bc-43d0-92ae-8b9fecf5585d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.704008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.704620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.704905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.705178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.749259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e236516-ea9f-4011-9ed7-30c21161ae29 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:14.773160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.774659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.782588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:14.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:14.783561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:14.783872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:14.813161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.850869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:14.852381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:14.864888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:14.873198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 44/82] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:14.876611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.953947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 39/83] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:14.954627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:14.976156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51ff4-0b77-4cc9-8323-de80961375f0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.010355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.010959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.011234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.011508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.012180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.014316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.027491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.056582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d487-111d-4919-aecb-230ba3aab7fc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.067301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.089334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.089959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.090238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.090507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.091903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.093366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.094936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 40/84] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:14 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.095789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.133919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 45/85] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:14 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:15.133919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.206434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4193b-7f2f-4691-b369-1a138e406181 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.250732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.251377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.251667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.252078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.252765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:15.253078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.254492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.255177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40626e44-30c7-486e-b383-d5406f3213a0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.264554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 41/86] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.265448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.302048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.302694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.302975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.303246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.304433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.305934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.307561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 46/87] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.308366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.318861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.383515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.389829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732297-69f2-452c-9849-0f5a18ece133 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.435317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.435993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.436283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.436601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.436755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8df-1fa6-4e2f-9408-f736223f7bd5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.437925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.439397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.439397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 42/88] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.445202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.485201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.486071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.486364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.486640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.568407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4b48-10f8-443e-9978-2a58d57cb249 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.578443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.580796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.596211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.615186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.616366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.617077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.617594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.619657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.623068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.625540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 43/89] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.627037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.683502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.748179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 47/90] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:15.748860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.769544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f439-fd20-48f5-8b10-f79eb09b300c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:15.817641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:15.818657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:15.819153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:15.820029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:15.820984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:15.821513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:15.823256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:15.830814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 44/91] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=f6b2f10d1614446281653edfc178a15f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:15.833054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:15.920762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:15.944594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9c26-9684-4e4f-9aaf-fd2839a0481e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.021684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.022221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.022500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.023064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.023598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=57b1eaab77b840f39d5eb6bd620e915e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:16.023940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.025476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.032184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 48/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/role_assignments?user.id=57b1eaab77b840f39d5eb6bd620e915e&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:16.033157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:16.034229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8150c3b-7946-4c22-a9e1-3c6478ff4265 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.067420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:16.076617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.077244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.077525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.077977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.169842 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.171802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.218530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759b830-1347-493d-b3c4-12d4a81b4169 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.222588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:16.278676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.279320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.279530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.279703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.280901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.282371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.284451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 49/93] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:16 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:16.290557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:16.302135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 45/94] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:16.321687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:16.395465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:16.402100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa2123-429b-442d-b46f-82527724a1be None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.439292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.439954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.440237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.440513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.441250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:16.441564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.443017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.449202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 50/95] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:16 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:16.469122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8908d0-8cc3-44ab-b56c-1006924d3974 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.514054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.515075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.515568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.516083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] PATH_INFO: `/v3/projects/fca2c602b8a240e588caec7fcebc6aa8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.517478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] RBAC: Authorizing `identity:get_project(project_id=fca2c602b8a240e588caec7fcebc6aa8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.519145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866df5-1b8d-4d3b-a769-30cc38a9eb55 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.521131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 46/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:16 2022] GET /identity/v3/projects/fca2c602b8a240e588caec7fcebc6aa8 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:16.527228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:16.681683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109bdd-f359-4830-9000-d944eb0f81de None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:16.719216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:16.719857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:16.720141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:16.720416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:16.721149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=fca2c602b8a240e588caec7fcebc6aa8, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:16.721457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:16.722913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7a4a2-b1c9-499a-945b-2b542a7fb278 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:16.729337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 51/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:16 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=fca2c602b8a240e588caec7fcebc6aa8&role.id=f6b2f10d1614446281653edfc178a15f => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:17.698422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c6c1-9bb8-45ff-ade5-d239605ce0f6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:17.699430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c6c1-9bb8-45ff-ade5-d239605ce0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:17.699939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c6c1-9bb8-45ff-ade5-d239605ce0f6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:17.702101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 47/98] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:17.707102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:17.707557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:17.707648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:17.710207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2a3f-d6ee-48a2-a0c0-8e63a2140db5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:17.710697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2a3f-d6ee-48a2-a0c0-8e63a2140db5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:17.711242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2a3f-d6ee-48a2-a0c0-8e63a2140db5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:17.713048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 48/99] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:17.719275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:17.719837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:17.720310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:17.736878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:17.738209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:17.740986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:17.742462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:17.744761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:17.756760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:17.816506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 52/100] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:17.834457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 49/101] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:18.218970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:18.338672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b5215-6966-4f68-8025-d608c405c7f9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:18.379973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:18.380621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.380901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.381174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.382305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:18.384576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:18.388835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:18.394878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 53/102] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:18.400426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:18.431609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:18.564410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f897b7-f00a-4981-b35f-6d0e476b93fb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:18.616859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd5684-0038-4a3b-a749-8408fe666cc6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:18.640075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:18.640982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.641090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.641330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.641983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:18.643453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4962a-d0ad-4810-8863-46a6111cad58 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:18.676673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:18.677714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.678191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.678689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.693501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:18.698160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:18.704069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:18.705403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:18.706169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:18.708676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 50/103] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:18.714661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:18.775629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 54/104] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:01:18 2022] POST /identity/v3/projects => generated 302 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:18.829976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9baae-c943-4008-8329-0b1dbe900ee4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.830260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9baae-c943-4008-8329-0b1dbe900ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.830499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9baae-c943-4008-8329-0b1dbe900ee4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.832270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 55/105] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:18.837595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.838012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.838295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.865227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d371fd-8265-436e-8112-16cd6ad72bdf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:18.876733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:18.878050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:18.909606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:18.910241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:18.910520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:18.911074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:18.911785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:18.912102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:18.913570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:18.923788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 51/106] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:18.929982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:19.022298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.050093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 56/107] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:19.092908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7e62-681b-422e-bc7f-0443dfd7a416 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:19.136506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:19.137138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.137414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.137745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] PATH_INFO: `/v3/users/adcea59f654d4d6bace905d9af411a74` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.163170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] RBAC: Authorizing `identity:get_user(user_id=adcea59f654d4d6bace905d9af411a74)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:19.164696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fc12a-9c4e-4a83-992d-c85131458377 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:19.166369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 52/108] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:18 2022] GET /identity/v3/users/adcea59f654d4d6bace905d9af411a74 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:19.172431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:19.175650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.268389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9886-f9ff-427b-871d-eead82aa6367 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.268724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9886-f9ff-427b-871d-eead82aa6367 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.268934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9886-f9ff-427b-871d-eead82aa6367 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.270263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 53/109] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:19.275351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.275634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.275982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.301376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:19.302565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:19.328317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e44619-b945-45d6-89e6-180f099d9943 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:19.389350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 54/110] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:19.401676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:19.402583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.403087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.403834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.512018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:19.514876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c005-3ad2-4e53-a21f-adc4b1b197bd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:19.519777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.598048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:19.674855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 57/111] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:19.677092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a12485-a1bb-4243-b508-f8fa5595e428 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.677643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a12485-a1bb-4243-b508-f8fa5595e428 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.678111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a12485-a1bb-4243-b508-f8fa5595e428 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.679658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 58/112] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:19.681417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a297fb-7de2-4545-82d7-50c2ae15f9df None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.681950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a297fb-7de2-4545-82d7-50c2ae15f9df None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.682472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a297fb-7de2-4545-82d7-50c2ae15f9df None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.684226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 59/113] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:19.686063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a297fb-7de2-4545-82d7-50c2ae15f9df None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:19.697339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.757243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6e5ee-eced-44ab-bfc0-14edd21906ec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:19.797390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:19.798033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.798308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.798580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.808936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c54c8073-b75a-4d4d-83a5-a96ec572c217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:19.813636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:19.814471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:19.815647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:19.816647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a297fb-7de2-4545-82d7-50c2ae15f9df None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:19.817048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 55/114] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:19.817048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.817402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.817500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.817904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.838051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:19.840136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:19.864325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:19.865347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.865803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.866252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.868190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:19.870750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecfc6e-b704-41ac-b88b-865b7aed314e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:19.873230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 60/115] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:19 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:19.874416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:19.874694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:19.874963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:19.893100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:19.894285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:19.938234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 56/116] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:19.939686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:19.983304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:19.986581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 61/117] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:19.987847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.068964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c8c45-333c-4699-83c1-bd583a36206e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.110370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.111014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.111346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.111632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.125028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:20.130350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:20.131214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 57/118] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:20.138004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.165037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7341592-8fca-47d5-a448-ae2959ee1566 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.168087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.262653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.267565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41d28-acc3-4bb6-9b69-84cb4d243545 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.276485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.277115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.277397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.277674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.278586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:20.278952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.280384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.303253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 62/119] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.303253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.315538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.316404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.316827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.317243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.318113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=adcea59f654d4d6bace905d9af411a74) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:20.318582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.320215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.326398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 58/120] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/role_assignments?user.id=adcea59f654d4d6bace905d9af411a74&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=22b61739ddf84b45b1582d50252663a4 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.327437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.450116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789e10-dfc1-4472-80fb-e555f8e5491f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.461820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6a4da-3eb0-45ba-9369-034602f0a0f4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.492804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.493364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.493640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.493912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.506557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:20.508478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.509248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.509669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.510082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.510907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:20.511348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:20.512833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:20.513976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:20.514716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 59/121] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:20.515336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.516050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.528004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 63/122] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.529588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.556227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.562954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.676380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6205b-268b-4f66-96d2-535e6a93aa24 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.676915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549a2b7-443c-452a-9b1d-751cad5d953b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.719929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.720799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.721068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.721413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.721701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.721973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.722077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.722249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.723547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.726004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.728432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 60/123] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.729331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.741525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:20.749696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:20.750708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 64/124] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:20.751668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.850708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.858833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:20.862119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eac745-ec1e-4af9-9a04-e5a6298d6271 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.875612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c16d-31bd-4fd4-adfd-9d4969808b80 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:20.898874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.899496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.899806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.900178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.900752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:20.901057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.902454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.915826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 61/125] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.915826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:20.916373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:20.917844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:20.918125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:20.919800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:20.920627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:20.922515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:20.924275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 65/126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:20.925175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.038392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95a3db-07ed-4679-9d45-a838cde2c492 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.039841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55aecf-011b-43b8-8981-4c07278c544d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.074119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.075728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.076242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.076699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.076798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.077417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.077715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.078063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.078735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:21.078834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.079025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.080517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.080924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.087496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 62/127] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.088571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.089552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 66/128] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.090269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.107826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.120917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.198343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40230e66-bd94-42a1-a17c-a9c5048f02a2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.209519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145264-17b6-4266-aec3-ce1dc326335d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.245333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.246080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.246361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.246638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] PATH_INFO: `/v3/projects/fca2c602b8a240e588caec7fcebc6aa8` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.248631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=fca2c602b8a240e588caec7fcebc6aa8)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.250202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.250321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.251132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.251600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.256606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 67/129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:21 2022] GET /identity/v3/projects/fca2c602b8a240e588caec7fcebc6aa8 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.256606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.257540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.259116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.260798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.263790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 63/130] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:21 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.269069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.342330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.362081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26693b7-d8d1-4bea-8423-5e9dc576a5f5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.368785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.382316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b21a-f32b-4f29-997a-1b238e07a3b5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.398064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.398746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.399076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.399354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/4e85099d5b7741119941c9160b2618b9/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.401294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, user_id=4e85099d5b7741119941c9160b2618b9, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.402766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c631c-9e3b-4249-8f42-0103bde6a9c0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.417567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.418232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.418516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.418852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.420318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.421810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.423470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 64/131] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:21 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.428453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.500050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 68/132] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:21 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/4e85099d5b7741119941c9160b2618b9/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:21.501631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd66b-be67-4fa3-aac8-17e78b47315d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.501925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd66b-be67-4fa3-aac8-17e78b47315d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.502204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd66b-be67-4fa3-aac8-17e78b47315d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.507681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 69/133] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:21.507681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd66b-be67-4fa3-aac8-17e78b47315d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.536928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58a34-7abe-45ce-9920-34bcb2e2b2b1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.579229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.580108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.580396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.580711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] PATH_INFO: `/v3/projects/fca2c602b8a240e588caec7fcebc6aa8/users/4e85099d5b7741119941c9160b2618b9/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.582754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fca2c602b8a240e588caec7fcebc6aa8, user_id=4e85099d5b7741119941c9160b2618b9, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.584481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.662256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd66b-be67-4fa3-aac8-17e78b47315d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.690901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 65/134] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:21 2022] PUT /identity/v3/projects/fca2c602b8a240e588caec7fcebc6aa8/users/4e85099d5b7741119941c9160b2618b9/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:21.696228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.706073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.706737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.707017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.707283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.711993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.713530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7726996-c4d5-4fc8-aac6-e1b11d682b6c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.715340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 70/135] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:21 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.717237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.718734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.724921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.727156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.761863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:21.763807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:21.783519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:21.874581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e57cda-4ab9-48aa-b48f-0a34c412e8b2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:21.885510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 71/136] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:21.886346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:21.916341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:21.917363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:21.917836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:21.918391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:21.920575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:21.922341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:21.924579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 66/137] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:21 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:21.932926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:22.024092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72ff4-d516-4722-a5e4-dd2e4d5f256a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:22.067749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:22.090105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7fdd9-9384-49e1-bba9-121bd6a1e7ea None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:22.094182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:22.094846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.095121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.095389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/57b1eaab77b840f39d5eb6bd620e915e/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.104611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, user_id=57b1eaab77b840f39d5eb6bd620e915e, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:22.106455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:22.156625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:22.157683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.158163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.158640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/4e85099d5b7741119941c9160b2618b9/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.161201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, user_id=4e85099d5b7741119941c9160b2618b9, role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:22.162895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187cb5b-2ea0-4111-92a4-8526b5318bb1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:22.178506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:22.181358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 72/138] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:21 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/57b1eaab77b840f39d5eb6bd620e915e/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:22.243142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:21 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/4e85099d5b7741119941c9160b2618b9/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:01:22.289993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:22.416733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d1c73-f9f3-4b47-889e-2aebc377c509 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:22.449706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7d38c-41f6-4fba-974e-ecaca6c9dc7e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.450599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7d38c-41f6-4fba-974e-ecaca6c9dc7e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.450881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7d38c-41f6-4fba-974e-ecaca6c9dc7e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.452481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 68/140] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:22.458224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.458513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.458788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.470201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:22.471450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.471998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.472482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.473940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:22.476958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:22.479268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 73/141] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:22.489686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:22.502500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:22.505409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:22.579076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:22.625166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 69/142] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:22.627514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fd9dc-44fe-4cdb-88ad-44c5067075fb None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:22.674062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:22.675062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:22.675599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:22.676163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:22.677014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:22.680146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:22.794993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 74/143] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:22 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:01:23.042234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:23.161410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:23.197008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac876155-43ca-48a0-9a04-5acbda6c12e9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:23.255520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:23.256563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:23.257037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:23.257501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:23.272127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:23.279813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:23.280861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:23.281638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:23.285363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 70/144] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:23.291065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:23.455191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4d413-463a-4d49-99e7-ae5c4af0777c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:23.492153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:23.511419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:23.512077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:23.512400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:23.512728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:23.513409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:23.513704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:23.515161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:23.529089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 75/145] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:23.535218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:23.684334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886de64-97cd-4332-b39f-9884db6c1b3b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:23.723313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:23.723912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:23.724202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:23.724473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] PATH_INFO: `/v3/users/adcea59f654d4d6bace905d9af411a74` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:23.726144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] RBAC: Authorizing `identity:get_user(user_id=adcea59f654d4d6bace905d9af411a74)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:23.727606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:23.729539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 71/146] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:23 2022] GET /identity/v3/users/adcea59f654d4d6bace905d9af411a74 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:23.735343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:23.851186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3856c68-2e8c-4640-8091-f6eaa25211fe None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:23.898006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:23.898638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:23.898912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:23.899179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:23.900356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:23.901800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a93651-135b-42ad-a5c6-b3ac2a889bad None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:23.903614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 76/147] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:23 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:23.910158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:23.913206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:24.037332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce0991-0530-412a-9928-66fbd052e5ed None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:24.083400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:24.084174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:24.084369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:24.084636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/adcea59f654d4d6bace905d9af411a74/roles/22b61739ddf84b45b1582d50252663a4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:24.086580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, user_id=adcea59f654d4d6bace905d9af411a74, role_id=22b61739ddf84b45b1582d50252663a4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:24.088058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187237-e0b5-478d-b077-b19b07b86897 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:24.161679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 72/148] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:23 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/users/adcea59f654d4d6bace905d9af411a74/roles/22b61739ddf84b45b1582d50252663a4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:24.449745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a8098-43ce-44df-a43c-669f71197f37 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:24.450372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a8098-43ce-44df-a43c-669f71197f37 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:24.450372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a8098-43ce-44df-a43c-669f71197f37 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:24.452173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 77/149] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:24.457479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538d1a-990b-4ec4-b2e2-39b9a19fe6f7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:24.457758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538d1a-990b-4ec4-b2e2-39b9a19fe6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:24.458029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538d1a-990b-4ec4-b2e2-39b9a19fe6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:24.481475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f7538d1a-990b-4ec4-b2e2-39b9a19fe6f7 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:24.482672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f7538d1a-990b-4ec4-b2e2-39b9a19fe6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:24.551234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:24.562086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 73/150] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:25.044771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a8098-43ce-44df-a43c-669f71197f37 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:25.122800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:25.170544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a8098-43ce-44df-a43c-669f71197f37 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:25.204989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:25.205624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.211778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.211778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.214284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa837-7748-404c-8ff5-60bdb095151f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.214716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa837-7748-404c-8ff5-60bdb095151f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.214880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa837-7748-404c-8ff5-60bdb095151f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.217030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 74/151] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:25.224287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d5c3-741c-4fa3-85f1-0b1644cce166 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.224565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d5c3-741c-4fa3-85f1-0b1644cce166 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.224829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d5c3-741c-4fa3-85f1-0b1644cce166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.250809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:25.260771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-abd2d5c3-741c-4fa3-85f1-0b1644cce166 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:25.261958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-abd2d5c3-741c-4fa3-85f1-0b1644cce166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:25.267876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:25.268709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:25.269441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 78/152] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:25.289620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:25.395661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 75/153] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:25.396803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc422-ce8a-421f-97b2-77fd85994eb2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.397093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc422-ce8a-421f-97b2-77fd85994eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.397366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bc422-ce8a-421f-97b2-77fd85994eb2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.398608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 76/154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:25.405217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3b7a-0df1-480b-a5cf-388185d986eb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.405548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3b7a-0df1-480b-a5cf-388185d986eb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.405826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3b7a-0df1-480b-a5cf-388185d986eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.428187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-295d3b7a-0df1-480b-a5cf-388185d986eb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:25.429364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-295d3b7a-0df1-480b-a5cf-388185d986eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:25.511514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e4753-8461-472b-ac97-51b277bb00c6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:25.532078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:25.547780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:25.567201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:25.568142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.568615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.569094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.569976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:25.570471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:25.572078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:25.585564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 79/156] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:25.587253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd5f2-8a18-47b3-a6fa-a00f26cd38e3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.587591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd5f2-8a18-47b3-a6fa-a00f26cd38e3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.587999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbd5f2-8a18-47b3-a6fa-a00f26cd38e3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.589519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 78/157] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:25.595646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:25.600473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.600748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.601016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.628935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:25.630209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:25.710676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:25.740899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fe350-9b0a-4852-bece-7bf527219127 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:25.741154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 79/158] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:25.790875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:25.791542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.791845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.792118 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:25.796437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:25.797917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:25.799510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 80/159] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:25 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:25.805499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:25.939256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa973d-4097-4b8c-9575-5380b5bf1a0a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:25.991166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:25.991166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:25.991166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:25.991166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.048233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.075511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:26.077032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:26.123915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.217133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 80/160] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:26.230798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.251884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.340151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82908e80-b511-4564-a3e7-90d98dca29e5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:26.356173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.384433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:26.385436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:26.385618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74e9c-a143-4168-98f4-ef6f1533e758 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:26.386097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:26.386569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.398172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:26.403901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:26.404779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:26.405565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:26.408226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 81/161] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:26.409303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.447233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:26.447916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:26.448192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:26.448460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.449598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:26.457828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:26.459831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 81/162] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:26.460610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.644130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd7ac-6320-4609-98a1-2e74b296ac1a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:26.648223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.651483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555150c3-fdfd-418b-bcd1-7072cad574ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:26.714736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:26.715970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:26.716258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:26.716517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.720451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:26.721086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:26.721363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:26.721632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.742050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:26.747552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:26.748445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:26.749206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 82/163] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:26.749854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.751223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:26.761792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:26.764222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 82/164] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:26.766325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:26.781326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:26.881935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca949323-d07e-4df8-8c68-1390755e3235 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:26.917917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:26.919121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:26.919795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:26.920277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:26.921163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:26.921667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:26.923261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:26.932014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 83/165] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:26.933096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.013886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.025926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59feb2de-cd32-452d-8318-443963536c54 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.039421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dc1e5-08b6-4acd-9636-3f0251fb1ca6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.077635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.078624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.079125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.079586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.080617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:27.081127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.082755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.091456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 84/166] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.092749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.099092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.099712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.100019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.100289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.101074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:27.101382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.102851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.115701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 83/167] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:26 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=f6b2f10d1614446281653edfc178a15f => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.120006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.174285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.261820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fc124-e101-4c13-a9fe-bf46d881b4fd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.306261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255a15-0394-45ec-9f04-ee85d6c7238a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.316513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.317483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.317958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.318433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.319291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:27.319901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.321547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.327783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.336426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 85/168] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.347908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.384694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.385347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.385624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.385891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.388837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.390345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.392046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 84/169] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.393198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.504150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30813c-e8a7-4277-a5d0-896fc8918e93 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.555179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.555839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.556117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.556385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] PATH_INFO: `/v3/users/4e85099d5b7741119941c9160b2618b9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.561773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=4e85099d5b7741119941c9160b2618b9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.563235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.565578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 86/170] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/users/4e85099d5b7741119941c9160b2618b9 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.566365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.603922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.617285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1021845-41cb-4432-bb67-9cb97b68bdcf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.663419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.664088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.664458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.664737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] PATH_INFO: `/v3/users/57b1eaab77b840f39d5eb6bd620e915e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.666102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] RBAC: Authorizing `identity:get_user(user_id=57b1eaab77b840f39d5eb6bd620e915e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.667576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276d36-6c6f-435b-8ed4-fa110a82b240 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.672555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 85/171] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/users/57b1eaab77b840f39d5eb6bd620e915e => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:27.673704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5cf1c-9094-40da-b4f9-5c4e96ae24cd None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.673983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5cf1c-9094-40da-b4f9-5c4e96ae24cd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.674255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5cf1c-9094-40da-b4f9-5c4e96ae24cd None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.675664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 86/172] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:27.676340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5cf1c-9094-40da-b4f9-5c4e96ae24cd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:27.691952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.738354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1142e79-ccc6-425f-ac66-392333436cd8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.777835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.778960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.779436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.780016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.831234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5cf1c-9094-40da-b4f9-5c4e96ae24cd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:27.856571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.858402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.870515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:27.871124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:27.871434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:27.872571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:27.908572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.929552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:27.950623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:27.952216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7b14-5c19-442b-ab7a-f75fc9175e3c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:27.979338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:27.980267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.066740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 87/174] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:28.068374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391747a-e2cc-47c1-8bfa-5e7e577d155d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.068654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391747a-e2cc-47c1-8bfa-5e7e577d155d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.068921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391747a-e2cc-47c1-8bfa-5e7e577d155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.087903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4391747a-e2cc-47c1-8bfa-5e7e577d155d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:28.088308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b923-62f0-4d05-91c3-b65de5d4a5f2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.089083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4391747a-e2cc-47c1-8bfa-5e7e577d155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:28.124866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.125482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.125752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.126015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.150736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.158302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.159556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e4cb-cf6d-497c-80f3-c2b6a70fb5d1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e4cb-cf6d-497c-80f3-c2b6a70fb5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e4cb-cf6d-497c-80f3-c2b6a70fb5d1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 89/176] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b35a3-b9c1-48c9-8683-45707f86e9e7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.166959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b35a3-b9c1-48c9-8683-45707f86e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.171874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b35a3-b9c1-48c9-8683-45707f86e9e7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.171874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 90/177] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:28.171874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b35a3-b9c1-48c9-8683-45707f86e9e7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.207870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.210121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.283898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b35a3-b9c1-48c9-8683-45707f86e9e7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.322277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.323227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.323699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.324220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] PATH_INFO: `/v3/projects/fca2c602b8a240e588caec7fcebc6aa8` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.324443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 88/178] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:28.325444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.329763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] RBAC: Authorizing `identity:get_project(project_id=fca2c602b8a240e588caec7fcebc6aa8)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.331569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8625e-accf-43ea-aff3-ed1ac83c15d7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.333434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 91/179] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/projects/fca2c602b8a240e588caec7fcebc6aa8 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:28.334802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54299-0cd5-4657-9009-a8cf36500c72 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.335219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54299-0cd5-4657-9009-a8cf36500c72 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.335629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54299-0cd5-4657-9009-a8cf36500c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.354200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e1a54299-0cd5-4657-9009-a8cf36500c72 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:28.355605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e1a54299-0cd5-4657-9009-a8cf36500c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:28.394462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.420152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.433376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 92/180] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:28.435173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.435457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.435729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.440678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e275dc-6ecc-4ef8-9125-c89fc61b798b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.453751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:28.454933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:28.476130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.476963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.477277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.477501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.478917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.480424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380bc0-509b-4474-9d26-15ba457bb9bb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.482851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 89/181] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:28.483876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc993-fb3c-42fc-85b5-83cf5be2a879 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.484151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc993-fb3c-42fc-85b5-83cf5be2a879 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.484418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bc993-fb3c-42fc-85b5-83cf5be2a879 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.485591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 90/182] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:28.486277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc993-fb3c-42fc-85b5-83cf5be2a879 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.535785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 93/183] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:28.535785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.620591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bc993-fb3c-42fc-85b5-83cf5be2a879 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.651443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca038a-e51a-47f7-a72f-bae7e818e1a8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.655883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.656588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.656988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.657323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.658507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.660119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.662031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 91/184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:28.662705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.666899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.679067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.693613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.694923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.695169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.695662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.696435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=fca2c602b8a240e588caec7fcebc6aa8, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:28.696743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.698971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.707115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 94/185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=fca2c602b8a240e588caec7fcebc6aa8&role.id=f6b2f10d1614446281653edfc178a15f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:28.711743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.783189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9db2-1a75-4b5e-b8bf-d8b03856eb8d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.819427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.820102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.820378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.820655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.833342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b51abe07-6e9f-4899-8aac-c8e983be53ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:28.838774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:28.839724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 92/186] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:28.844991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.845825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.845825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.850293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4be59b-8c22-466e-9e82-5dda237be3f2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:28.862760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:28.864319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:28.892322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:28.892867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:28.893144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:28.893416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:28.894145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=4e85099d5b7741119941c9160b2618b9) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:28.894460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:28.895934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:28.902207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 95/187] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/role_assignments?user.id=4e85099d5b7741119941c9160b2618b9&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:28.903142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.939000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:28.956298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 93/188] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:28.961795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:28.974206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.038583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfc6f-84f9-409d-946a-14655b03820d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.071992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83834452-4c39-4e4a-a1cb-4f7b4beb66f9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.079351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.080320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.080825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.081273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.082175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=57b1eaab77b840f39d5eb6bd620e915e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:29.082793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.084621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.092091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 96/189] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/role_assignments?user.id=57b1eaab77b840f39d5eb6bd620e915e&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.093009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.118972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.119691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.119996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.120269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.139196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:29.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:29.145895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:29.146673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:29.149215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 94/190] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:29.150424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.215502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.226049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6585d5-5dab-4dfa-8bf5-0d6ba0ebd22d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.242972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.272820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.273466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.273743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.274024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.284729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb860ccd-43c3-42b7-b08f-93b82f8120ce None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.289483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:29.294772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:29.295669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:29.296510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 97/191] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:29.297150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.329176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.329816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.330057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.330325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.331000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:29.331305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.332746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.342528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 95/192] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.344386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.409082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce07b-b34c-4595-8bc3-a28bea7e16ab None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.442325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.442923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.443203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.443470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.444157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:29.444454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.445309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf4c55-f863-4d7e-bc1d-5d7f66d50802 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.445843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.454202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 98/193] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.459117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.459216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.479031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.479656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.479955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.480219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.481324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.482955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.484541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 96/194] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.489325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.490015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.557740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8369cd-8752-4596-a8ae-fbc9f8b45051 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.589072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c37806-3d5a-4970-aaeb-89e72522ec46 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.593937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.594538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.594810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.595072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.595724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:29.596049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.597416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.605527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 99/195] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.607265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.624445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.625069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.625346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.625615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.638559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.640038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.641774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 97/196] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.642353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.681456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.707903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:29.711494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd326fcc-9e44-426d-a198-e9dc9d08c2a0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.739971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f017a6-44bf-43da-ae6e-244c30de6d37 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.746156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.746801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.747073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.747345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.748503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.749937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.751545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 100/197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.752281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.778721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.779404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.779682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.779973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.780608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.782039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.849783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8f64-10cd-4b89-87cf-b449fc047f29 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:29.882863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:29.883473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:29.883746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:29.884038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] PATH_INFO: `/v3/users/adcea59f654d4d6bace905d9af411a74` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:29.885135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] RBAC: Authorizing `identity:get_user(user_id=adcea59f654d4d6bace905d9af411a74)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:29.886586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:29.889101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 101/198] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/users/adcea59f654d4d6bace905d9af411a74 => generated 289 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:29.889854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.912637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 98/199] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:29 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:29.913463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:29.923563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.007511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a409-2e42-4225-ba6c-2832eb1cce4c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.032571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.040568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c134257-d9d2-4d32-aab5-630e59e2048c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.046974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.047595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.047904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.048174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.082611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.083285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.083552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.083895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.131920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.133417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.172914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.175166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.177469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.264953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 102/200] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:30.266019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.298076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.305987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 99/201] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:30.306935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.403461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf16dad-2bf0-43c6-a550-be2805d29a50 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.424830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8113-2b99-487d-aeb1-9b31facb9fbe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.447897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.448515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.448788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.449054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.452312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.470647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.471284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.471559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.471856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.474239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.475979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.479152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 100/202] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:30.480219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.525952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.527404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.573314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.617702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7abc9-2b77-46e2-a99e-adc81456bebc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.638513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 103/203] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:30.639519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.669677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.670308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.671147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.671419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.672824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.674125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.679793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 101/204] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:30.679793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.687540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.767310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4d0f-6a3e-4170-b477-b84be8a4523a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.799668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f6e7-cfb6-40aa-b320-21d11914ab9d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:30.809880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.810663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.811131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.811665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.812699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=3fb06ab7eff7458d99659e4dd93bc698) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:30.813222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.814938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.821386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 104/205] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/role_assignments?user.id=3fb06ab7eff7458d99659e4dd93bc698&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:30.822467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.834582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.842466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:30.843500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:30.843986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:30.844419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:30.846105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:30.848031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:30.850809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 102/206] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:30.861017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:30.964288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:30.975988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78671a9f-b25d-4aa5-a510-538f90339e53 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:31.035062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8351-b491-4026-b806-5918a1b974e0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:31.047087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:31.048120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:31.048596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:31.049061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:31.050654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=3fb06ab7eff7458d99659e4dd93bc698) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:31.051172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:31.053255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e6b8-24c6-4fdc-b006-d6ca7110d88b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:31.060781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 105/207] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/role_assignments?user.id=3fb06ab7eff7458d99659e4dd93bc698&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:31.087614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:31.088873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:31.089156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:31.089434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:31.090934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3, user.id=adcea59f654d4d6bace905d9af411a74) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:31.091246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:31.092794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4681e-74a5-4f34-8ca2-5ed9ff031be0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:31.100569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 103/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:30 2022] GET /identity/v3/role_assignments?user.id=adcea59f654d4d6bace905d9af411a74&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=22b61739ddf84b45b1582d50252663a4 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:32.121163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97953-ba78-4897-8abb-aa831b443235 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.121836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97953-ba78-4897-8abb-aa831b443235 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.121952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97953-ba78-4897-8abb-aa831b443235 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.123526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 106/209] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:32.128889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.129288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.129473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.148319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:32.149537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:32.169570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71ad-63d2-4bc5-a1e2-ce27a4e30768 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.169856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71ad-63d2-4bc5-a1e2-ce27a4e30768 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.170106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71ad-63d2-4bc5-a1e2-ce27a4e30768 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.171690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 107/210] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:32.176702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.176983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.177253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.196826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:32.198025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:32.229547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:32.232170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 104/211] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:32.283270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 108/212] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:32.506005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:32.554505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:32.623147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58455a9-85bb-4c17-b228-62e1eddcedfe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:32.656002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:32.661701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:32.662341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.662619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.662890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.665912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce5809-b95a-4aa6-b0d0-c13d2a072ee3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:32.674126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:32.678898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:32.679775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:32.680782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 105/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:32.687569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:32.710514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:32.711154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.711430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.711701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.713019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:32.714790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:32.717353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 109/214] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:32.725065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:32.754797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:32.810534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a736b-0dc8-4cfb-8627-d4901285ae65 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:32.853656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856f4b1-babb-4c5a-93aa-42c89cce5605 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:32.854334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:32.855107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.856312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.856723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.858434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:32.858880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:32.860433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:32.871373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 106/215] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:32.877570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:32.903690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:32.904339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:32.904618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:32.904886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:32.905533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:32.907471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399efc9f-0c2c-4774-89a1-b6c5a6831260 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:32.986631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015df8-e82d-4137-80ac-8a0c87d95ade None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.000806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.016220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 110/216] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:32 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:33.021832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.022681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.023101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.023514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] PATH_INFO: `/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.026213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e340-540e-433a-9f8e-3a00001fc9fb None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.026639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e340-540e-433a-9f8e-3a00001fc9fb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.027053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e340-540e-433a-9f8e-3a00001fc9fb None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.029697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 111/217] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:33.036936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758ad9-364f-4a3f-926c-d893a5c47491 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.037345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758ad9-364f-4a3f-926c-d893a5c47491 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.037711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758ad9-364f-4a3f-926c-d893a5c47491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.043026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] RBAC: Authorizing `identity:get_user(user_id=9298651d0f6f4d119a4b7a1c175c1d6d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:33.045904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:33.048400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 107/218] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:32 2022] GET /identity/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:33.054631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.069169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0a758ad9-364f-4a3f-926c-d893a5c47491 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:33.071362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0a758ad9-364f-4a3f-926c-d893a5c47491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:33.088267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.183870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 112/219] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:33.194953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d969-1e22-434c-9968-a08bc6449ed8 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.195536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d969-1e22-434c-9968-a08bc6449ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.196011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d969-1e22-434c-9968-a08bc6449ed8 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.197600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 113/220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:01:33.202790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.202935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc3969-cea0-4388-bbb9-ba56984b0d72 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.203347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.203347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.223526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:33.224772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:33.258256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.259251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.259837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.260110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.313885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 114/221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:33.315031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.349709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:33.351142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:33.463001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 108/222] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:33.469079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.472797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.562744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.563475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.587215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0c5c0-1adb-4335-97c9-006ce8d08913 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.595842 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a0b1-04bd-4658-be32-d9732aaab728 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.625663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.626219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.626506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.626776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.627959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:33.629631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:33.632011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 115/223] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:33.632793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.634107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.634958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.635437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.635938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.653389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:33.659211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:33.660101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:33.660884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:33.663743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 109/224] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:33.664845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.755680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f75065-c9b5-40fa-a128-0f0108ac66c7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.790056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bbb0c-b4d0-499f-ad6f-fbb0f0ef14a4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:33.804931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.806026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.806557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.806838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.822162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:33.822727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.828053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:33.828779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:33.828908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:33.829856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:33.830895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 116/225] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:33.831822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:33.834831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:33.834831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=9298651d0f6f4d119a4b7a1c175c1d6d) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:33.834831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:33.834831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:33.835643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:33.841030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:33.842205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 110/226] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/role_assignments?user.id=9298651d0f6f4d119a4b7a1c175c1d6d&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=f6b2f10d1614446281653edfc178a15f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:33.843075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.009694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0f439-90c1-4ec5-9d03-62e9df1fdf27 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.039707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dda0-5429-42bb-a244-085b888f6f20 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.055654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.056314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.056592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.056861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.057536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:34.057839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.059843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.080442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 111/227] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.086998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.112480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.113104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.113384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.113658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.114338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:34.114638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.116051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.135242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 117/228] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.138836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.174924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:34.219019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51808-ed79-4efa-85b5-293921133dd2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.261182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.261744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.262612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.262885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.264106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.265567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.267155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 112/229] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:34 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.272949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.295561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:34.336224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7858f-1210-429f-97a4-913a40e3b08f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.384263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.384903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.385180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.385451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.388726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.390195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.391822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 118/230] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:34 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.401865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.469051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac32ac3-0bfd-4d64-9487-59e0be886c6c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.524326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804cc00-2573-4331-a972-10c34c481f15 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.535612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:34.563626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.564310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.564584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.564851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.566330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.567856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.569619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 113/231] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:34 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.571401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.572092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.572366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.572632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.575386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.576930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.579824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.580876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 119/232] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:34 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:34.588779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:34.594778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:34.693079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222174e-c314-4f7d-8e25-bfbb5452828c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.772098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff66af-15db-49db-ba12-f417c9bce41d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:34.774390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.775013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.775293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.775563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/3fb06ab7eff7458d99659e4dd93bc698/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.782174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, user_id=3fb06ab7eff7458d99659e4dd93bc698, role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.783634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f49f-a8bf-46cb-a9e7-0b5695c4068e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.807714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:34.808455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:34.808735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:34.809572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/3fb06ab7eff7458d99659e4dd93bc698/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:34.811559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, user_id=3fb06ab7eff7458d99659e4dd93bc698, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:34.813132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756f85-ab3f-4889-bdad-e7e2857eb2d5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:34.898222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 114/233] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:34 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/3fb06ab7eff7458d99659e4dd93bc698/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:34.937381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 120/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:34 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/3fb06ab7eff7458d99659e4dd93bc698/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:35.570147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6348a1-a89f-457b-bfc1-7231feac3822 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:35.570655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6348a1-a89f-457b-bfc1-7231feac3822 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:35.570655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6348a1-a89f-457b-bfc1-7231feac3822 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:35.571975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 115/235] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:35.578329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:35.578901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:35.578901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:35.606325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:35.607509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:35.651184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea656-4fbf-43d3-b1bb-9190125d841a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:35.651488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea656-4fbf-43d3-b1bb-9190125d841a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:35.651783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea656-4fbf-43d3-b1bb-9190125d841a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:35.655294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 116/236] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:35.659641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bbd2-71f7-4dd5-b6b6-c2f17a6fc567 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:35.659951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bbd2-71f7-4dd5-b6b6-c2f17a6fc567 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:35.660217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323bbd2-71f7-4dd5-b6b6-c2f17a6fc567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:35.690560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 121/237] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:35.691127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:35.691748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5323bbd2-71f7-4dd5-b6b6-c2f17a6fc567 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:35.692827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5323bbd2-71f7-4dd5-b6b6-c2f17a6fc567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:35.765648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:35.792284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 117/238] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:36.049888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.130101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188673-1473-4920-bd67-d15efb26d073 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.130542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188673-1473-4920-bd67-d15efb26d073 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.131179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188673-1473-4920-bd67-d15efb26d073 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.137486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 118/239] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:36.142965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115890-0be6-4648-b352-1c88077209f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.143247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115890-0be6-4648-b352-1c88077209f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.143507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115890-0be6-4648-b352-1c88077209f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.168877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-87115890-0be6-4648-b352-1c88077209f3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:36.170051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87115890-0be6-4648-b352-1c88077209f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:36.175076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4dca-d0b2-4e43-ae5f-c7f9a4f564a3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.214120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.215273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.215806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.216376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.217716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:36.219723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:36.221858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 122/240] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:36.222941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.242347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 119/241] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:36.243188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87115890-0be6-4648-b352-1c88077209f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.304224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:36.346219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87115890-0be6-4648-b352-1c88077209f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.352143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081527a1-a329-4298-a6ce-2a22ff4baae1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.363660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:36.393907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.394598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.394879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.395149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.407339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:36.408564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.409184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.409461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.409726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.410364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:36.411842 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:36.412590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:36.413422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:36.414202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 123/242] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:36.420583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.515057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 120/243] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:36 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:36.532765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d4b5-1fb8-46ea-bbe5-0ce63e21d13c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.556847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:36.572188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.572918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.573195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.573461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.574190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:36.575237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:36.576739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:36.587153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 124/244] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:36.594439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.642206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.754219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95864331-fcf2-44c1-8031-7c9d84e0b8d4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.770016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f15b0-b200-4af6-b7a7-c47d46b2f88f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.792088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.792727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.793004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.793808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] PATH_INFO: `/v3/users/aff3d08178804be7b10938dc79adc77a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.813642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] RBAC: Authorizing `identity:get_user(user_id=aff3d08178804be7b10938dc79adc77a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:36.815061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:36.819778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 121/245] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/users/aff3d08178804be7b10938dc79adc77a => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:36.820491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:36.821194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:36.821473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:36.821741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:36.823610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.834855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:36.841896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:36.842791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:36.843558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 125/246] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:36.848745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:36.870509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:36.918977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:36.974004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bd7a-0536-4601-a7f4-e0f1056e93a4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:36.994048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef40b2-b924-4e38-bf0b-130da54f12a2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.020978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.021767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.022297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.022748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.040910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.041834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.042471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.042923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.044908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:37.045648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.047410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.061818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 126/247] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:37.069239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.127679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.129533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.166793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:37.214797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82d51f-3f8a-431b-bac4-446d40856bb8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.218121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:37.252153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 122/248] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:37.258391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.262391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.263190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.263569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.263872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] PATH_INFO: `/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.265086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] RBAC: Authorizing `identity:get_user(user_id=9298651d0f6f4d119a4b7a1c175c1d6d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.266548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56944dcf-fcdd-4f29-8ffd-b2fc6dd07162 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.268578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 127/249] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:37 2022] GET /identity/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:37.269771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1378a-8e48-4a05-9058-41e1a0ece7c2 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.270049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1378a-8e48-4a05-9058-41e1a0ece7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.270316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1378a-8e48-4a05-9058-41e1a0ece7c2 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.279668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 128/250] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:37.281100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1378a-8e48-4a05-9058-41e1a0ece7c2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.390949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b26d-ba1d-4b3d-a3b5-395c8d9d8885 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.417754 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1378a-8e48-4a05-9058-41e1a0ece7c2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.422262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:37.432193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.432839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a71e2-13c9-4799-9356-403ee30dc111 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 123/251] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:37 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:37.440113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.440504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.440504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.461623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:37.463141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:37.465761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.467357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.467639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.467995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.472124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.473600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.476054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 129/252] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:37 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:37.477129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.551063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 124/253] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:37.552010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.568295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:37.663432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeea5b-ea8b-4cec-9257-22396765ef2e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.726711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.728086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.728359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.728885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.729606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=aff3d08178804be7b10938dc79adc77a) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:37.729903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.732246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876562a-469f-44e9-b101-d084060440d8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.739420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802f427-f88f-41b9-a2ed-923d26afe888 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:37.746861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 130/254] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:37 2022] GET /identity/v3/role_assignments?user.id=aff3d08178804be7b10938dc79adc77a&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=22b61739ddf84b45b1582d50252663a4 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:37.748262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560c40-a271-422e-857e-9a49a11b0d7a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.748538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560c40-a271-422e-857e-9a49a11b0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.748804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3560c40-a271-422e-857e-9a49a11b0d7a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.750009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 131/255] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:37.755819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.756131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.756362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.775696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:37.777129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:37.800126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:37.808380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:37.809635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:37.817621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:37.817621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/9298651d0f6f4d119a4b7a1c175c1d6d/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:37.817621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, user_id=9298651d0f6f4d119a4b7a1c175c1d6d, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:37.817621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:37.889040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 132/256] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:37.904042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 125/257] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:37 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/9298651d0f6f4d119a4b7a1c175c1d6d/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:37.928256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:37.976633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:38.055769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38046d7-ee5a-4bbf-abcf-43389b2fa49a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.102325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.102959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.103235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.103782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.118398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:38.123446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:38.124350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:38.125129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 133/258] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:38.131099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.267211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceae730-0b98-47a1-af86-c6e82b92c32c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.283733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.315138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.315806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.316075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.316347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.317027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:38.317328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:38.318720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:38.334631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 126/259] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:38.340925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.472148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:38.522555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:38.537737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cf7c6-5bd4-4ac6-90d1-85eca2d063ac None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.596713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917462b-59c0-48b6-baec-7b59fede3691 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.628497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.629152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.629427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.629695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.676712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:38.681657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:38.682515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:38.683289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:38.687845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 134/260] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:38.689399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.693403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.694302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.694768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.695277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.700549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:38.702243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:38.704064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 127/261] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:38.709822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.859889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e752-066a-43c0-9958-d1339a9a33d0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.921542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eab04-4f13-49b7-b1ad-ddfdea212ada None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:38.925565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.926197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.926473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.926741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.927416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:38.927713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:38.929138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:38.945939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:38.947164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 135/262] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:38.953055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:38.976822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:38.977445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:38.977719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:38.977986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:38.986557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:39.051716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:39.053381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:39.165153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 128/263] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:39.172809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:39.200991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:39.281896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84149-d66d-45a4-a3b6-0a7c31478f5d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:39.368031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:39.368669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.368944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.369213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] PATH_INFO: `/v3/users/3fb06ab7eff7458d99659e4dd93bc698` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.375641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] RBAC: Authorizing `identity:get_user(user_id=3fb06ab7eff7458d99659e4dd93bc698)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:39.377262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:39.379305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 136/264] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:38 2022] GET /identity/v3/users/3fb06ab7eff7458d99659e4dd93bc698 => generated 283 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:39.387113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:39.410752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48484414-8992-461e-9ffd-f0cfbb4d5f71 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:39.483618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:39.484683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.485179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.485645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.488143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:39.489799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018ef29-3a9a-4a18-a86b-e1553f8a6ccb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:39.495444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 129/265] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:39 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:39.500995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffe3-6729-4bf7-a1b8-7664029ee396 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.501503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffe3-6729-4bf7-a1b8-7664029ee396 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.503020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffe3-6729-4bf7-a1b8-7664029ee396 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.505878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 130/266] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:39.508826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ffe3-6729-4bf7-a1b8-7664029ee396 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:39.564113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:39.605117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe2b9f-f569-46e2-ad57-87f24a47b15e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:39.635884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:39.666155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ffe3-6729-4bf7-a1b8-7664029ee396 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:39.728712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:39.729721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.730203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.731232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.732361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=3fb06ab7eff7458d99659e4dd93bc698) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:39.732909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:39.734619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8f322-9c86-4fbc-ab96-552804c1f8c3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:39.749135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 131/267] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:39 2022] GET /identity/v3/role_assignments?user.id=3fb06ab7eff7458d99659e4dd93bc698&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:39.755790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87b31-1295-4221-a052-3506602dc408 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.756495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87b31-1295-4221-a052-3506602dc408 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.756973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87b31-1295-4221-a052-3506602dc408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.797461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0fc87b31-1295-4221-a052-3506602dc408 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:39.799029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0fc87b31-1295-4221-a052-3506602dc408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:39.820561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:39.821257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:39.821512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:39.821782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:39.945875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 132/268] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:40.068065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:40.069931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:40.159533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d25a-9f29-4b6c-b65f-469a0a2ef733 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.159934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d25a-9f29-4b6c-b65f-469a0a2ef733 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.160116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5d25a-9f29-4b6c-b65f-469a0a2ef733 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.161600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 133/269] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:40.166846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.167128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.167398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.210497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:40.216265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:40.217614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:40.246518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 137/270] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 860 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:40.253246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.354409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 134/271] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:40.358665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.371339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:40.418617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7e02f-53cf-4bc8-ac65-3c859e7e9f7b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:40.457884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:40.458854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.459319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.459800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.462413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:40.464852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:40.467601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 138/272] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:40.473227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.596142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:40.611490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca837ec0-4b33-41ab-a782-314e028974cb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:40.656409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:40.657384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.657982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.658398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.662433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f895-7e73-4fd8-a83d-42459850202b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:40.671207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dd4a379a-56b9-4239-926b-b560b5792430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:40.678084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:40.679160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:40.680134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:40.681605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 135/273] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:40.682690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217d98-a670-4a68-adfb-cf98c404cc5a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.683074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217d98-a670-4a68-adfb-cf98c404cc5a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.683254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217d98-a670-4a68-adfb-cf98c404cc5a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.686776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 136/274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:40.686776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217d98-a670-4a68-adfb-cf98c404cc5a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.709800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:40.710395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.710668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.710931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.711649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=3fb06ab7eff7458d99659e4dd93bc698) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:40.711976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:40.713411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:40.719857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 139/275] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/role_assignments?user.id=3fb06ab7eff7458d99659e4dd93bc698&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:40.720328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.770819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:40.811976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217d98-a670-4a68-adfb-cf98c404cc5a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:40.843738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725ee7-36a5-4704-b321-cf499db845e3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:40.850227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:40.850879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.851155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.851431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.852618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:40.854391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889c52d-b5d2-4201-b4e3-d22af3094ff5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:40.856694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 137/276] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:40.858073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770aaf-4218-4914-860c-db167a59e749 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.858367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770aaf-4218-4914-860c-db167a59e749 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.858622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af770aaf-4218-4914-860c-db167a59e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.864475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:40.877225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-af770aaf-4218-4914-860c-db167a59e749 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:40.878546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-af770aaf-4218-4914-860c-db167a59e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:40.885273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:40.886137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.886656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.887191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.888071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:40.888371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:40.889868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deabe17-4061-46e0-ab1e-a0aa12fa51e9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:40.899590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 140/277] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:40.900892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d0b1-da2e-4209-acb2-ca491ca988de None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:40.902962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d0b1-da2e-4209-acb2-ca491ca988de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:40.902962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d0b1-da2e-4209-acb2-ca491ca988de None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:40.903634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 141/278] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:40.904512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d0b1-da2e-4209-acb2-ca491ca988de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:40.964481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 138/279] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:40.965929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770aaf-4218-4914-860c-db167a59e749 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.021135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d0b1-da2e-4209-acb2-ca491ca988de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.038086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.056044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.059576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.059576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.059576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.059576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.059576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.076184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af770aaf-4218-4914-860c-db167a59e749 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.110760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.111389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.111666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.111994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] PATH_INFO: `/v3/users/2d0e60878a0f49739d99442b4be036dc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.124899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e60878a0f49739d99442b4be036dc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.126332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab9df9-fcb4-4e73-a78e-8b9449710ca7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.128090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 139/280] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:40 2022] GET /identity/v3/users/2d0e60878a0f49739d99442b4be036dc => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:41.129202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.129481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.129752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.148731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:41.149991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:41.169609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 142/281] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:01:40 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:41.170619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.227659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 140/282] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:41.238459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.241789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.313034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.353216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c17fd-c5ac-4908-8a97-431f040677f7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.376817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460c513-7f31-41c3-ad53-17381428ec13 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.396977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.397583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.397859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.398129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.398850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, user.id=2d0e60878a0f49739d99442b4be036dc, scope.system=all) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:41.399154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.400624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.408262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 143/283] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/role_assignments?user.id=2d0e60878a0f49739d99442b4be036dc&scope.system=all&role.id=f6b2f10d1614446281653edfc178a15f => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:41.417704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.418558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.418836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.419115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.432552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:41.438189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:41.439159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:41.440013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 141/284] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:41.447007 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.518441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.581555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.586161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ae11c-81fc-4a6d-84eb-bccb9195df62 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.629495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.630045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.630315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.630581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.631258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:41.632088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.633787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.645715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 144/285] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:41.652873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6bed-cd30-4117-ad0f-783bace82fb5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.653404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.670511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.708968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.709607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.709882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.710150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.734462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:41.740053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:41.740917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:41.741691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:41.745021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 142/286] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:41.751666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.829722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c1bbd-d0ba-438d-a087-bc27af75ff76 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.865961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.866713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.866886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.867136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] PATH_INFO: `/v3/users/aff3d08178804be7b10938dc79adc77a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.868533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] RBAC: Authorizing `identity:get_user(user_id=aff3d08178804be7b10938dc79adc77a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.870052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.877119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 145/287] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/users/aff3d08178804be7b10938dc79adc77a => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:41.881586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:41.931451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a34363-c98a-45f5-95c4-a45dce3cb4cb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:41.950193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:41.972029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:41.972719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:41.972908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:41.973177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:41.973845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:41.974142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:41.975530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:41.988044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 143/288] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:42.009332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:42.057439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:42.093771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558df2-8f3d-49ec-ba59-1395d38f5e7f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.133095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.133645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.133920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.134186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.139779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.139779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:42.140421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 146/289] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:41 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:42.147186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:42.179546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035fb4b-86a3-4dad-9510-2a3f48b88e8c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.253572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.254206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.254482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.254749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] PATH_INFO: `/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.256509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] RBAC: Authorizing `identity:get_user(user_id=9298651d0f6f4d119a4b7a1c175c1d6d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.257963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:42.264206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 144/290] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:42 2022] GET /identity/v3/users/9298651d0f6f4d119a4b7a1c175c1d6d => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:42.269740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:42.317387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:42.328605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599b689-c394-4613-8607-c899d04ea566 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.412444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f18009-e189-4532-bc30-4eb050c3fe17 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.414981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:42.436460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.437386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.437866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.438340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/aff3d08178804be7b10938dc79adc77a/roles/22b61739ddf84b45b1582d50252663a4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.442834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, user_id=aff3d08178804be7b10938dc79adc77a, role_id=22b61739ddf84b45b1582d50252663a4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.444554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:42.451783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.451783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.451783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.451783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.525255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.526738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:42.536030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 147/291] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:01:42 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/users/aff3d08178804be7b10938dc79adc77a/roles/22b61739ddf84b45b1582d50252663a4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:42.637861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 145/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:42.643777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:42.800306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb194-8d09-4fe3-b086-34685ac66108 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.839395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.840648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.840896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.841170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.842292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.843728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c396-76c1-484c-9cdf-51d6bf797252 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:42.845656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 148/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:42 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:42.851520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:42.857410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:42.955732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17925ee0-9828-4a9a-aa8f-602accde399d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:42.990225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:42.990880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:42.991141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:42.991412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:42.992204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=9298651d0f6f4d119a4b7a1c175c1d6d) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:42.992507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:42.993929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a258-1638-4cdd-a895-4a89227cf8d6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:43.000732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 146/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:42 2022] GET /identity/v3/role_assignments?user.id=9298651d0f6f4d119a4b7a1c175c1d6d&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=f6b2f10d1614446281653edfc178a15f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:43.604498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51144b-52a5-4792-b5b3-c2cb5b73fe5c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.604976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51144b-52a5-4792-b5b3-c2cb5b73fe5c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.604976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51144b-52a5-4792-b5b3-c2cb5b73fe5c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.607055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 149/295] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:43.613268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c5958-f5b2-43f9-bed1-fd1bfc9e3900 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.613528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c5958-f5b2-43f9-bed1-fd1bfc9e3900 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.613806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c5958-f5b2-43f9-bed1-fd1bfc9e3900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.633082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7016-d04c-4240-a70b-e958360f2008 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.633377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7016-d04c-4240-a70b-e958360f2008 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.633627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a7016-d04c-4240-a70b-e958360f2008 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.633832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-929c5958-f5b2-43f9-bed1-fd1bfc9e3900 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:43.635122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 150/296] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:43.635300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-929c5958-f5b2-43f9-bed1-fd1bfc9e3900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:43.640523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ea0b-7c61-4b0a-ae3d-6a9d63d1cce2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.640804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ea0b-7c61-4b0a-ae3d-6a9d63d1cce2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.641079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4ea0b-7c61-4b0a-ae3d-6a9d63d1cce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.688786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-89b4ea0b-7c61-4b0a-ae3d-6a9d63d1cce2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:43.690935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-89b4ea0b-7c61-4b0a-ae3d-6a9d63d1cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:43.702257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:43.711788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 147/297] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:43.719718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:43.771815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 151/298] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:43.898759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456cf4-18f8-4dec-9251-5b78147ec62f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.899375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456cf4-18f8-4dec-9251-5b78147ec62f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.899889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456cf4-18f8-4dec-9251-5b78147ec62f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.901731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 148/299] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:43.907923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:43.908438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:43.908901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:43.927916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:43.929363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:43.988298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456cf4-18f8-4dec-9251-5b78147ec62f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.005197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 152/300] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:44.042316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.095827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456cf4-18f8-4dec-9251-5b78147ec62f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.130084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.130708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.130984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.131255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.132407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.133962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.134119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.135989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 149/301] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:44.144489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.160346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b960e8e-056a-4f25-aa88-815a90952325 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.198434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.199730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.200104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.200540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.212017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:44.213198 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:44.218264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:44.219123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:44.219910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:44.229757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 153/302] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:44.236406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.251619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72073318-7f41-4fad-acfc-b1e11171da84 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.292507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.294275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.294779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.295432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] PATH_INFO: `/v3/groups` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.296574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.298251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.343986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af447c-49eb-4ffb-a551-2786f4a51fa3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.378713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.379329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.379601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.379911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.380577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:44.380903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.381546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 150/303] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 24 18:01:44 2022] POST /identity/v3/groups => generated 229 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:01:44.382274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.382716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.403875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 154/304] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:44.405129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.418790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.520114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de16368-3d3d-49ed-8d11-d991977d1da4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.554203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a296d-b1bf-46a8-9a63-0c5d4d485d7a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.555520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.566797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.567434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.567785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.568058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.582391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:44.587272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:44.588408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:44.589390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 151/305] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:44.595220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.596079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.596488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.596757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.597095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] PATH_INFO: `/v3/users/2d0e60878a0f49739d99442b4be036dc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.598457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e60878a0f49739d99442b4be036dc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.600085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.602130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 155/306] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/users/2d0e60878a0f49739d99442b4be036dc => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:44.608627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.694562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.708432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850945-7b31-43f8-8276-8074660e7ed3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.722299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fe144-e500-4f9a-90cd-f4ad640fd1e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.747948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.748624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.748979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.749165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.749839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:44.750137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.751517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.761181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 152/307] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:44.762891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.763712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.764157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.764570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] PATH_INFO: `/v3/system/users/2d0e60878a0f49739d99442b4be036dc/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.766277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d0e60878a0f49739d99442b4be036dc, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.766857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:44.767989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc35e-9c94-416a-a42a-f8c99d4e3549 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.820172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:44.872259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea6553-5e65-47a8-8996-a616dc22ce30 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:44.890464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 156/308] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 24 18:01:44 2022] PUT /identity/v3/system/users/2d0e60878a0f49739d99442b4be036dc/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:01:44.892215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add745cb-35b6-4100-b12e-6ea99b69cf17 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.892710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add745cb-35b6-4100-b12e-6ea99b69cf17 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.893199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add745cb-35b6-4100-b12e-6ea99b69cf17 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.895153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 157/309] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:44.903328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.903998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.905183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.915952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:44.920764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:44.921348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:44.921695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] PATH_INFO: `/v3/users/de827cf4b259444da159c7a21ab58930` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:44.930110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:44.931434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:44.938958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] RBAC: Authorizing `identity:get_user(user_id=de827cf4b259444da159c7a21ab58930)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:44.941193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:44.943176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 153/310] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/users/de827cf4b259444da159c7a21ab58930 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:44.948670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:45.016274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 158/311] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:45.072063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedb7df-63ff-4232-90b1-d948da32606b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:45.080759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:45.109627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:45.110437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:45.110536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:45.110799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:45.111573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, user.id=de827cf4b259444da159c7a21ab58930, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:45.111912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:45.113516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:45.124146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 154/312] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 18:01:44 2022] GET /identity/v3/role_assignments?user.id=de827cf4b259444da159c7a21ab58930&scope.system=all&role.id=22b61739ddf84b45b1582d50252663a4 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:45.289241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:45.358030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:45.394353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f2c05-f6c7-437c-b38b-1058cf0d6fca None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:45.431326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:45.432344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:45.432812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:45.433292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:45.444807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:45.449879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:45.450763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:45.451532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:45.453810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 159/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:45.461065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:45.575142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3733ba-1092-4711-bd95-89debf7beb5e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:45.614614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:45.615252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:45.615530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:45.615836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:45.616521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:45.616820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:45.618223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:45.627930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 155/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:45.633257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:45.739578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af6a4-0a41-4242-8a04-e56899a47646 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:45.765915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:45.773429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:45.774106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:45.774386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:45.774657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] PATH_INFO: `/v3/users/aff3d08178804be7b10938dc79adc77a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:45.776048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] RBAC: Authorizing `identity:get_user(user_id=aff3d08178804be7b10938dc79adc77a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:45.778102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:45.784261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 160/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:45 2022] GET /identity/v3/users/aff3d08178804be7b10938dc79adc77a => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:45.785944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:45.818772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:45.893433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5d81-aa8a-4d51-b8c9-619cb599a620 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:45.937440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:45.938279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:45.938694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:45.939127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.010218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:46.012031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:46.045961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:46.117739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 156/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:46.124330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:46.233337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0115a3-dd94-43b3-8939-e23877811592 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:46.273593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:46.274572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.275077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.275566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.276925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:46.279415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508929b3-95b0-47a7-88a0-8a8ef2adcf5d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:46.281431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 161/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:46 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:46.287993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:46.392534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52628e3-12d0-4324-95a4-f5921db8e155 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:46.424881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:46.427292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:46.427923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.428198 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.428465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.429209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96, user.id=aff3d08178804be7b10938dc79adc77a) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:46.429481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:46.430906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a34b-8ac1-4744-bbf7-1a8208d195a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:46.437832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 157/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:01:46 2022] GET /identity/v3/role_assignments?user.id=aff3d08178804be7b10938dc79adc77a&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=22b61739ddf84b45b1582d50252663a4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:46.501338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d24f-faa3-4c08-9bb5-761bb5a042e4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.501510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d24f-faa3-4c08-9bb5-761bb5a042e4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.501778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d24f-faa3-4c08-9bb5-761bb5a042e4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.503466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 162/319] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:46.509302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec809-c564-44c8-a001-4a69ac0ab7a8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.509575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec809-c564-44c8-a001-4a69ac0ab7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.509846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec809-c564-44c8-a001-4a69ac0ab7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.530848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-308ec809-c564-44c8-a001-4a69ac0ab7a8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:46.532094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-308ec809-c564-44c8-a001-4a69ac0ab7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:46.615226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 158/320] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:46.883240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274d24f-faa3-4c08-9bb5-761bb5a042e4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:46.926431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdb2-7c8a-4cdf-90a2-6ed65bbe677c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.926751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdb2-7c8a-4cdf-90a2-6ed65bbe677c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.926969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdb2-7c8a-4cdf-90a2-6ed65bbe677c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.928480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 159/321] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:46.933244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:46.933682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:46.934085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:46.952621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:46.953917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:46.954301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:46.997552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274d24f-faa3-4c08-9bb5-761bb5a042e4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.028166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 160/322] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:47.037378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.038009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.038286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.038552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.039677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:47.041157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d036f-c10a-4377-ac35-914d5745631e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:47.043078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 163/323] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:47.048376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.107673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:47.151301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913938-28aa-4d63-a1f1-3728722d52a1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.154722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6411e1-0f17-4a1c-97ef-7f90d024e207 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.155080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6411e1-0f17-4a1c-97ef-7f90d024e207 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.155432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6411e1-0f17-4a1c-97ef-7f90d024e207 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.157049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 164/324] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:47.161892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.162178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.162447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.180924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:47.182089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:47.188006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.188626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.188905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.189176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] PATH_INFO: `/v3/groups` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.189865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:47.191263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:47.253940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 165/325] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:47.282184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 161/326] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 24 18:01:47 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:01:47.297911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.366244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:47.409745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4bd4-40f0-4faa-ab3b-21b931862a25 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.447439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.448097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.448375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.448658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.459913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:47.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:47.466096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:47.466863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 166/327] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:47.472128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.538022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.593199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5b4f6-aab0-463e-9945-3dfa25142974 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.617400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:47.644183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.644860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.645138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.645408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.646068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:47.647080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:47.647915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:47.657592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 162/328] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:47.664385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.677165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471633-22ca-4ace-b68a-23252157f8db None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.712213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:47.727434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.728181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.728784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.729061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.743410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:47.749666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:47.750585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:47.751536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 167/329] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:47.757713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.820172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445a36-97f8-482b-8b92-8fc526cdf66a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.871497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.872870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.873381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.874101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] PATH_INFO: `/v3/users/2d0e60878a0f49739d99442b4be036dc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.875993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] RBAC: Authorizing `identity:get_user(user_id=2d0e60878a0f49739d99442b4be036dc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:47.877938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:47.883328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 163/330] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/users/2d0e60878a0f49739d99442b4be036dc => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:47.887179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd86344-b0ea-433b-95bc-8520012e0b32 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:47.889004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.929776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:47.930582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:47.930582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:47.931008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:47.931814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:47.932179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:47.933833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:47.943032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 168/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:47.948771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:47.958729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:48.013589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:48.035732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008a817-e7ba-48bc-9063-d809f4e67b92 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:48.077275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:48.078152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:48.078566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:48.079016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:48.079940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] RBAC: Adding query filter params (role.id=f6b2f10d1614446281653edfc178a15f, user.id=2d0e60878a0f49739d99442b4be036dc, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:48.080501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:48.082320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:48.088428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53cc8b-8343-4799-aec2-fe7355e89e64 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:48.098546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 164/332] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/role_assignments?user.id=2d0e60878a0f49739d99442b4be036dc&scope.system=all&role.id=f6b2f10d1614446281653edfc178a15f => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:48.135992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:48.137515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:48.137792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:48.138057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] PATH_INFO: `/v3/users/de827cf4b259444da159c7a21ab58930` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:48.141091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] RBAC: Authorizing `identity:get_user(user_id=de827cf4b259444da159c7a21ab58930)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:48.142578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536a0b5-1a65-4ab2-825d-9362fbdece4a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:48.144586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 169/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:47 2022] GET /identity/v3/users/de827cf4b259444da159c7a21ab58930 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:48.149941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:48.281223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be608-adc7-4176-9ee9-28574b73d5ac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:48.284112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:48.320439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:48.321100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:48.321379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:48.321649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] PATH_INFO: `/v3/system/users/de827cf4b259444da159c7a21ab58930/roles/22b61739ddf84b45b1582d50252663a4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:48.323080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de827cf4b259444da159c7a21ab58930, role_id=22b61739ddf84b45b1582d50252663a4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:48.325169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1537628-7f10-46d2-b2ea-330b49070244 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:48.399972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 165/334] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 24 18:01:48 2022] PUT /identity/v3/system/users/de827cf4b259444da159c7a21ab58930/roles/22b61739ddf84b45b1582d50252663a4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:49.512570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fecfa8-d7b8-4a3c-92af-c17391372b64 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:49.513098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fecfa8-d7b8-4a3c-92af-c17391372b64 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:49.513098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fecfa8-d7b8-4a3c-92af-c17391372b64 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:49.514604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 170/335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:49.520801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514d-c908-47ff-80bf-879421d40818 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:49.521249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514d-c908-47ff-80bf-879421d40818 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:49.521321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514d-c908-47ff-80bf-879421d40818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:49.542000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c793514d-c908-47ff-80bf-879421d40818 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:49.544592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c793514d-c908-47ff-80bf-879421d40818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:49.637953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 166/336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:49.685961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80553-a9d7-458f-96ca-52bd8c78a2f1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:49.686236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80553-a9d7-458f-96ca-52bd8c78a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:49.686504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80553-a9d7-458f-96ca-52bd8c78a2f1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:49.687858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 171/337] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:49.694056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:49.694338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:49.694643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:49.717383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:49.718544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:49.806030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 167/338] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:50.040205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d80553-a9d7-458f-96ca-52bd8c78a2f1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.169554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d80553-a9d7-458f-96ca-52bd8c78a2f1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:50.183073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:50.215463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:50.216269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:50.216549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:50.216823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:50.227245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.235892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:50.240328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:50.241184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:50.241971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:50.246177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 172/339] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:50.252503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.317174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:50.383796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb5933-b3a8-4167-ade6-c816d0d33cc0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:50.437499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:50.438348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:50.438798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:50.439212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:50.440067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:50.440508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:50.442050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:50.458397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 173/340] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:50.464045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.468038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76456a4-83bc-4c46-8213-e89a03a4b8a1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:50.536101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:50.540614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:50.541253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:50.541529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:50.541875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:50.572720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:50.582698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:50.584807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:50.586417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:50.589414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 168/341] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:50.597784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.683595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f33a00-0a8e-421a-b1d2-b0f62f8a8472 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:50.753832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:50.769113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:50.770404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:50.770404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:50.770404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:50.783699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807590-f8a2-49d6-9177-d2fb087c8a35 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:50.862734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:50.863362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:50.863644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:50.863941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:50.864619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:50.864918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:50.866788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:50.883372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 169/342] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:50.890086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:50.952151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:50.953646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.023120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:51.046726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13aaf6-b0d3-4699-bf73-267287971c92 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:51.117898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:51.118699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.119070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.119433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.154803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 174/343] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:51.157606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:51.161602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:51.302773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:51.305925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6607-41a0-4abf-940a-0f2c13e0ba74 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.332973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783824dd-3473-41db-a73f-22a1f33fc02e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:51.416031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:51.417085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.417589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.418620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.420033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:51.422039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391d4e2-26ed-45df-beb5-e7259c2d14e8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.424690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 175/344] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:51 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:51.432450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70592-c8d0-45ae-bee7-201b8c2e9ef7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.433011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70592-c8d0-45ae-bee7-201b8c2e9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.433710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b70592-c8d0-45ae-bee7-201b8c2e9ef7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.435381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 176/345] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:51.437122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b70592-c8d0-45ae-bee7-201b8c2e9ef7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:51.442829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:51.521440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 170/346] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:01:51.523256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.523740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.524242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.547396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:51.549572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:51.571561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b70592-c8d0-45ae-bee7-201b8c2e9ef7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:51.612594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:51.613651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:51.614667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.614667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.614940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.621587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:51.623225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7989b5c-e921-4f87-acde-3d9dcb728dc3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.625115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 177/347] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:51 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:51.626350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07aa5-d50c-479f-a408-5717bbf65f42 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.631003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07aa5-d50c-479f-a408-5717bbf65f42 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.631003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07aa5-d50c-479f-a408-5717bbf65f42 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.632762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 178/348] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:51.635896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07aa5-d50c-479f-a408-5717bbf65f42 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:51.645056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 171/349] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:51.645785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:51.744675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:51.784646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279a326-9a3e-4867-a336-61c601dbfa2d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:51.806765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07aa5-d50c-479f-a408-5717bbf65f42 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:51.832947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:51.834029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.834513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.835270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.836935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=055d2557c42448e8a7321e920d3e8eb3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:51.837435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:51.840189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87db5-250b-4e50-80a6-8cd756fe5d6b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.849710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 172/350] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:01:51 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=f6b2f10d1614446281653edfc178a15f => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:51.850939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552bbc-e4dc-4f71-9f7f-21b655d18416 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.851222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552bbc-e4dc-4f71-9f7f-21b655d18416 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.851495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552bbc-e4dc-4f71-9f7f-21b655d18416 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.852937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 173/351] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:51.854084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.854362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.854633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.858502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:51.859140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.859415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.859852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.861273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:51.862742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156373a-35d4-40ad-8545-1c1572e04b52 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:51.867054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 179/352] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:51 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:51.868307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:51.868587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:51.868860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:51.899395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:51.900667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:51.907660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:51.908911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:51.981388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.039383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 174/353] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:52.040305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.041499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 180/354] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:52.042334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.125614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.161937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb180694-3f48-4d1c-bf0b-c5e6e421aef2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.171544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ac80f-c46a-480b-a167-f45448215a3f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.200102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.201317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.201317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.201501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.203061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:52.205075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:52.207837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 175/355] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:52.210714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.211506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.211957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.213759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.225474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ef0aa8fc-fbc2-4e47-ba9d-d3865e4958c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:52.232738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:52.233875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 18:01:52.234828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:52.237363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 181/356] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:52.240421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d7b-32b7-414f-b57a-0298bf0e0d27 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.241452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d7b-32b7-414f-b57a-0298bf0e0d27 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.241867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d7b-32b7-414f-b57a-0298bf0e0d27 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.243685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 182/357] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:52.251778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.251778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.251778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.272565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:52.272847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.274452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:52.350112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fce7-cdcf-4f63-ac1b-e30ef8d798b9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.359017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 183/358] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:52.360046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.391899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.392748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.393001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.393269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.394388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:52.394697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:52.396353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:52.403907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 176/359] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:52.469502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.528438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab813cc-debb-4d7f-a12c-32545d52d693 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.567826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.571797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.572404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.572679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.572946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.573620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:52.574875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:52.576493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:52.586735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 184/360] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:52.587733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.735324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b292c-8042-4297-a81e-0842ad9660f0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.751906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6074e-15a1-4b22-8ddb-93168b40e9ac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.757198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.759340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:52.780482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.781381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.781664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.781945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.794747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.795487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.796103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.796279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.797215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:52.802882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:52.809389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 185/361] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:52.810358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.814045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:52.817995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:52.820257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:52.822143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:52.824159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 177/362] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:52.827776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.935167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4968fb-6c84-4bba-a1c5-2e079bed7ef3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.956605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7690d-d5f7-4079-b860-ff663cffbf4c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:52.974955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.975594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.975935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.976204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] PATH_INFO: `/v3/users/de827cf4b259444da159c7a21ab58930` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:52.977454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] RBAC: Authorizing `identity:get_user(user_id=de827cf4b259444da159c7a21ab58930)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:52.979174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:52.986164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 186/363] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/users/de827cf4b259444da159c7a21ab58930 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:52.987089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:52.991714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:52.992375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:52.992647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:52.992913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.003780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:53.009428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:53.011521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 178/364] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:53.013467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.038333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.047638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.100432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115765b-1b05-4e02-943b-431e39a189a9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.130046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ce5e-23db-4712-a97e-38fd6a910c12 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.143262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.143904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.144182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.144444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.145101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:53.145397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.146756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.156145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 187/365] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:53.157035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.179264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.180748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.181174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.181852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.182665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:53.183571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.185831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.197353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 179/366] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:53.198497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.291326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487336c5-64df-413f-9b3f-da6a6ace5072 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.303613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.326537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.339928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.341018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.341479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.343365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.344895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] RBAC: Adding query filter params (role.id=22b61739ddf84b45b1582d50252663a4, user.id=de827cf4b259444da159c7a21ab58930, scope.system=all) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:53.345292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.347064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.347642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d441-3545-40a7-9292-bafcf587857b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.363594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 188/367] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/role_assignments?user.id=de827cf4b259444da159c7a21ab58930&scope.system=all&role.id=22b61739ddf84b45b1582d50252663a4 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:53.364540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.416643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.417544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.418091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.420561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.421443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:53.422143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.425082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.446764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 180/368] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:53.452074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.529892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293d04-54ec-4233-9226-9f013bd00441 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.571098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.572001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.572862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.573295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.615125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.668314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42876d-2ddf-458a-abc4-72af047ad998 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.673684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.675280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.717587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.718881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.719369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.720499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:53.748565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.825241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 189/369] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:53.826416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.827109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:53.829017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:53.912479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:53.958990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ae0c8-c1d2-4b5b-b323-3824b6d94d95 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:53.976012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 181/370] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:53.977965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:53.995901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:53.996343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:53.996619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:53.996881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.050028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.077546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.078936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.118345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55efd3b-656a-41b2-99cb-6f8f69a77dc5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.157073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.157611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.158619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.158930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.159236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.160454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.161887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.164031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 182/371] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.164696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.207740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 190/372] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:01:54.209162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.284099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9edbc-1203-42f0-b4a5-41276a771b43 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.305308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.326155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.327272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.327447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2422f4-c8da-4dfd-9212-0ab7c4f2fe78 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.327602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.327861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.331474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.333163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.335249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 183/373] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.342758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.372658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.374970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.374970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.374970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.378912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.378912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.380961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 191/374] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.382215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.425528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.464921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2d57-2d10-4bc3-b517-6e596981335b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.508724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.508724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.508724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.509073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] PATH_INFO: `/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.509150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6300a1-2ec4-4f3e-b7d3-7c691a22bce5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.511101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] RBAC: Authorizing `identity:get_project(project_id=2824d75c5b514c0dacffd09ee4e2eb05)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.512904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887006-e583-48ac-96b0-37d3715e350f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.514761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 184/375] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.515862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d26d-c996-45c8-ae88-cec1030f37b4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.516144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d26d-c996-45c8-ae88-cec1030f37b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.516508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d26d-c996-45c8-ae88-cec1030f37b4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.517828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 185/376] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:54.523277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d26d-c996-45c8-ae88-cec1030f37b4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.554473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.555102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.555376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.555639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.556782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.558346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.560266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 192/377] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.561051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.596904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.651376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d26d-c996-45c8-ae88-cec1030f37b4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.696877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.697657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.697909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.698183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.698588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.699840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:54.700926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.701551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10243d57-f723-4b2a-8901-7c8fcf5bfa05 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.702119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122edfb-3391-462c-8da1-db1497af2434 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.709012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 186/378] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=f6b2f10d1614446281653edfc178a15f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.710321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.710656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.717297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.737106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:54.738341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:54.753970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.754676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.754953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.755219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] PATH_INFO: `/v3/groups/c7f86016999a456fa3c762d77fa1b473` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.762194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] RBAC: Authorizing `identity:get_group(group_id=c7f86016999a456fa3c762d77fa1b473)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.763868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.766013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 193/379] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/groups/c7f86016999a456fa3c762d77fa1b473 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.766866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.842154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 187/380] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:54.843137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:54.899567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:54.926724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b03d-49f7-44cf-95e5-c23129c09391 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.965299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43256530-a651-48cb-8700-838e83dbebd1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:54.965959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:54.966633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.966902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.967174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.967996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:54.968261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:54.969744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff65723-4a3f-4848-8781-c9eafbbf856c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:54.976819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 194/381] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:54.984562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd483-54d5-44b3-ac74-7cf29b717657 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.984841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd483-54d5-44b3-ac74-7cf29b717657 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.985113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd483-54d5-44b3-ac74-7cf29b717657 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:54.986688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 195/382] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:54.997475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:54.997765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:54.998028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:55.013240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:55.014264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:55.014718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:55.015153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:55.016140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] RBAC: Adding query filter params (group.id=c7f86016999a456fa3c762d77fa1b473, role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=2824d75c5b514c0dacffd09ee4e2eb05) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:55.016645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:55.019510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:55.028621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 188/383] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:01:54 2022] GET /identity/v3/role_assignments?group.id=c7f86016999a456fa3c762d77fa1b473&scope.project.id=2824d75c5b514c0dacffd09ee4e2eb05&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:55.037147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:55.038384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:55.071630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:55.139360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 196/384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:55.202126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:55.358347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde2a8f-a2b1-4120-b0e6-77c9f65cf703 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:55.374286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:55.395750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:55.396403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:55.396680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:55.397003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:55.413081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:55.418995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:55.419891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:55.420685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 189/385] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:55.427568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:55.477503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:55.614329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5b6f-00cd-481d-ae45-ea02aaba9dd5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:55.669552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd134-5abc-4d95-8f21-817a554d2d1d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:55.694453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:55.695073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:55.695347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:55.695614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:55.696311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:55.696605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:55.697976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:55.721687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 197/386] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:55.726572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:55.727415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:55.729317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:55.730220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:55.732841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:55.757984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:55.766054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:55.766976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:55.767771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:55.776121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:55.776371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 190/387] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:01:55.795526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:55.866395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:55.947289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ccbf-16b1-43e3-89e1-6d11e0322cf0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.001746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.002758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.004443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.004982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.010057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.012618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.017881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 198/388] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:55 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:56.023493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:56.038834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148755f-085c-415d-8e0c-0743370c179b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.102862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.104109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.104587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.105588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.106471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:56.106964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.108614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.126119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 191/389] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:56.132831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:56.196153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:56.213702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062008e-efa7-42af-a4cb-a1de6666c78d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.271278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.272028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.272544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.273045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.274554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.276690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.279114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 199/390] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:56 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:56.284424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:56.397472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:56.407044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd9833-0eb5-425b-8de9-449c2dd92a8c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.430855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb7e4-cad6-4c2b-bd53-5613a4c19697 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.446445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.447100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.447378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.447651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.450173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, group_id=214ef00c1ec348a4ad2b102ce50b37ca, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.451682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.488489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.489402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.489865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.490269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.492505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.494296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.497196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 192/391] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:56 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:56.502919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:56.519005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 200/392] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 18:01:56 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:01:56.632128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9692ce3-9027-4ea3-ad29-be864dd714e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.677047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.677980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.678403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.678816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.680821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.682514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca033b-c6a3-4d73-98a1-49c3a42c2a48 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.685123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 193/393] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:56 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:01:56.692570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:56.716052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:56.810552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c231aec-0083-4465-bcb3-463274166e6c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:56.849035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:56.849690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:56.849965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:56.850232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:56.852390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=055d2557c42448e8a7321e920d3e8eb3, group_id=214ef00c1ec348a4ad2b102ce50b37ca, role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:56.854077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b84ab-c56b-41e5-ba64-9f56b85086a1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:56.953216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 201/394] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 18:01:56 2022] PUT /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:57.112041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136012-9560-49a7-916e-6118a8c9e68f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.112595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136012-9560-49a7-916e-6118a8c9e68f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.112595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb136012-9560-49a7-916e-6118a8c9e68f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.114219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 194/395] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:57.119838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25476c-581d-44b9-b694-25ad9f80105d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.120129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25476c-581d-44b9-b694-25ad9f80105d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.120406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25476c-581d-44b9-b694-25ad9f80105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.148221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-af25476c-581d-44b9-b694-25ad9f80105d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:57.149443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-af25476c-581d-44b9-b694-25ad9f80105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:57.244334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 202/396] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:57.479296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2d84-9e38-42b8-ace1-9a5261da5066 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.480635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2d84-9e38-42b8-ace1-9a5261da5066 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.481197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e2d84-9e38-42b8-ace1-9a5261da5066 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.483230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 195/397] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:57.488951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.489341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.489796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.510230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:57.521092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:57.522328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:57.588062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dfaa-be0d-498e-8e74-e83bf891a54f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.588395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dfaa-be0d-498e-8e74-e83bf891a54f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.588599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dfaa-be0d-498e-8e74-e83bf891a54f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.590424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 196/398] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:57.595557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.595869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.596145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.617828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:57.619097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:57.681801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:57.702341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 203/399] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:57.743066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 197/400] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:01:57.767645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:57.915605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74993c5b-d5de-4b8d-8447-d69ee427343e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:57.966734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:57.967368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:57.967639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:57.967932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:57.976706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:57.986146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:57.990922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:57.991872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:57.992702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 204/401] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:58.001683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.096468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.175946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027cf9-e91e-45aa-b1ef-e914a44a19f0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.208466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472a9c-04ff-41f7-948b-3992fcb274f8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.217183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.217998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.218878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.219315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.226738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:58.227493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.229630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.247478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 198/402] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.248530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.252585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.253390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.253816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.254242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.266579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:58.271337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:58.272256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:58.273038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 205/403] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:58.273685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.288115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.348025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.368142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a277a-9d13-4d91-bff7-48f59fd9e401 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.406604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885283-a534-40be-93ce-b5a568ff0681 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.409852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.410120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.410395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.410706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.422785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:58.428133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:58.429018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:01:58.429798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 199/404] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:58.430463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.455948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.456835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.457405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.457813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.459717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.461810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.464287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 206/405] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.465890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.523913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.544040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23892da-80da-433a-8551-fc8808f80454 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.584881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.585711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.586082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.586441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.587203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:58.587711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.589352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.595009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3aec-8862-4e26-88c2-8a946757ff76 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.603491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 200/406] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.603491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.629968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.645293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.646101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.646534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.646957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.647783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:01:58.648242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.650212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.666818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 207/407] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.668403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.718749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bb75b-6124-4807-ac38-67234e1fb06c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.756355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.756707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.757121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.757495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.758744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.760356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.763010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 201/408] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.764010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.781282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.792984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edde13-f696-43f9-b25a-7b8c4505a9f1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.837527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.838420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.838850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.839915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] PATH_INFO: `/v3/groups/c7f86016999a456fa3c762d77fa1b473` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.841523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] RBAC: Authorizing `identity:get_group(group_id=c7f86016999a456fa3c762d77fa1b473)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.843913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.845807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 208/409] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/groups/c7f86016999a456fa3c762d77fa1b473 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.846701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.892272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840c0b6-544e-4903-9396-01684bb8e87c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:58.911926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:58.930219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:58.930847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:58.931120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:58.931385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:58.932540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:58.934644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:58.936265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 202/410] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:58.937028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:58.964513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327c268-b666-475a-b9de-16dffb3aa092 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.001077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.001742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.002028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.002296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.004251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, group_id=214ef00c1ec348a4ad2b102ce50b37ca, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:59.005713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:59.023041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:59.041781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42725d6-c014-4284-ba3a-a2ccbffd2ef2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.075193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.075849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.078589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.078589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] PATH_INFO: `/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.078589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] RBAC: Authorizing `identity:get_project(project_id=2824d75c5b514c0dacffd09ee4e2eb05)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:59.079151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283f945-da88-4cca-8c7f-defcf8074801 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:59.080850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 203/411] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:58 2022] GET /identity/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:59.081950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147a10-b05b-4763-ac3e-ee498a886c5c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.082229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147a10-b05b-4763-ac3e-ee498a886c5c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.082545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147a10-b05b-4763-ac3e-ee498a886c5c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.083718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 204/412] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:59.087896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147a10-b05b-4763-ac3e-ee498a886c5c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.101450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 209/413] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 18:01:58 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:59.102257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.223036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147a10-b05b-4763-ac3e-ee498a886c5c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.261775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ca12-41b7-4aa9-8de9-0c42b287db13 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.266052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.266691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.266969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.267237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.269361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:59.270797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d662460-34f1-41f6-a3d7-540153a9657c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:59.272515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 205/414] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:01:59 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:01:59.273722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267127c3-bb96-4e67-884f-23909270a3ee None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.274006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267127c3-bb96-4e67-884f-23909270a3ee None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.274274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267127c3-bb96-4e67-884f-23909270a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.280372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:59.293489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-267127c3-bb96-4e67-884f-23909270a3ee None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:59.294300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-267127c3-bb96-4e67-884f-23909270a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:59.302470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.303402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.303987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.304472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] PATH_INFO: `/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05/groups/c7f86016999a456fa3c762d77fa1b473/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.305314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:59.307589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=2824d75c5b514c0dacffd09ee4e2eb05, group_id=c7f86016999a456fa3c762d77fa1b473, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:59.310207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924ad1-462e-4154-8b37-a21c47b52fcf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:59.360879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 206/415] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:59.362131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba5a5-d888-4a7a-9cc3-2ade1007fc96 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.362406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba5a5-d888-4a7a-9cc3-2ade1007fc96 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.362699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba5a5-d888-4a7a-9cc3-2ade1007fc96 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.367800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 207/416] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:01:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:01:59.367800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba5a5-d888-4a7a-9cc3-2ade1007fc96 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.384038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 210/417] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 18:01:59 2022] PUT /identity/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05/groups/c7f86016999a456fa3c762d77fa1b473/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:59.385948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.386332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.386674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.429123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:01:59.432455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:01:59.534550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ba5a5-d888-4a7a-9cc3-2ade1007fc96 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.568646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 211/418] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:01:59.577892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.579061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.579380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.579650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.581904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] RBAC: Authorizing `identity:create_grant(project_id=d43b876cd1ae41b495f576bc2ce22f96, group_id=214ef00c1ec348a4ad2b102ce50b37ca, role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:01:59.583377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:01:59.672872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 208/419] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 18:01:59 2022] PUT /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96/groups/214ef00c1ec348a4ad2b102ce50b37ca/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:01:59.689557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.798690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9d9fe-7aaa-4f22-8c67-8c93d2e645b5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:01:59.801367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:59.836419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:01:59.836964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:01:59.837309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:01:59.837545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:01:59.852805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:01:59.858359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:01:59.861586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:01:59.862363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 212/420] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:01:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:01:59.863029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.869073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:01:59.884699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:01:59.983511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788efa6e-d8d4-45b9-be84-62a081b18b13 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.030288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.031025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.031307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.031582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.032284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:00.032583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.032820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237995be-d448-4474-8e3e-3e13596bc513 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.034031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.049391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 213/421] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:00.056487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:00.082950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335daef0-b711-4430-ada7-fee33342536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.083590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335daef0-b711-4430-ada7-fee33342536b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.083888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335daef0-b711-4430-ada7-fee33342536b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.084157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335daef0-b711-4430-ada7-fee33342536b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.105371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335daef0-b711-4430-ada7-fee33342536b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:00.115059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-335daef0-b711-4430-ada7-fee33342536b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:00.115669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:00.116564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:00.117367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:00.120058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 209/422] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:00.124545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335daef0-b711-4430-ada7-fee33342536b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:00.239786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f40809-5ecc-4a76-8a8b-68a19c4689ff None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.263300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:00.277687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.278571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.279890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.279890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.352010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.353995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.377708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335daef0-b711-4430-ada7-fee33342536b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.393066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:00.441926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.442545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.442817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.443080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.443747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:00.444060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.445446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.462382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 210/423] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:00.466101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 214/424] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:02:00.468164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:00.471542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:00.591163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e7e3-4fa6-43e1-9168-e59d07e73f32 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.629890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.630892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.631328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.631773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.635931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:00.638066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.639950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.642220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 215/425] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:00.650306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:00.683647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986890e0-e315-4847-a8b1-9dd073b562d1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.711781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:00.723910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.727846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.727846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.727846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.829029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329ca91-1f47-4067-8f30-43afb243f84d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:00.846184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.847883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.888977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:00.889535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:00.889814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:00.890086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:00.891301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:00.893493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:00.900064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 216/426] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:00.903581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:01.020123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:01.029551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 211/427] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:02:01.036296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:01.082680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2eca1-5de0-44a5-a655-2a86b47e6653 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:01.085331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:01.150400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:01.150938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.151212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.151478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.152663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=055d2557c42448e8a7321e920d3e8eb3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:01.153173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:01.154641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:01.178084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 217/428] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:02:00 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=f6b2f10d1614446281653edfc178a15f => generated 611 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:01.204781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451dd22-0c65-4113-9480-73f5fe68cf97 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:01.285048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:01.286515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.287038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.287511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] PATH_INFO: `/v3/projects/055d2557c42448e8a7321e920d3e8eb3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.289042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] RBAC: Authorizing `identity:get_project(project_id=055d2557c42448e8a7321e920d3e8eb3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:01.290832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc59992-83bb-4254-bfee-06bf5f73dacf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:01.294001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 212/429] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:02:01 2022] GET /identity/v3/projects/055d2557c42448e8a7321e920d3e8eb3 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:01.301189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:01.390975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07208-523d-4287-97d5-f46286e9b1bb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.391257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07208-523d-4287-97d5-f46286e9b1bb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.391851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07208-523d-4287-97d5-f46286e9b1bb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.393774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 213/430] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:01.401461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabc75-1412-48c7-a977-beb59cb3e665 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.402675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabc75-1412-48c7-a977-beb59cb3e665 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.403102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cabc75-1412-48c7-a977-beb59cb3e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.426735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d0cabc75-1412-48c7-a977-beb59cb3e665 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:01.428389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d0cabc75-1412-48c7-a977-beb59cb3e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:01.449700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48344-c777-476a-b307-57d9c5fecc17 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:01.483863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:01.493484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:01.502207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 218/431] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:02:01 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:01.508154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:01.531414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 214/432] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:01.598333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dc0e-d66e-48a9-ba75-6d57a217a84e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.598614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dc0e-d66e-48a9-ba75-6d57a217a84e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.598892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4dc0e-d66e-48a9-ba75-6d57a217a84e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.601459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 215/433] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:01.608852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.610301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.610793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.634383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:01.635719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:01.640507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde4a24-caff-4b2f-a3e7-57a82205b76c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:01.666318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:01.684404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:01.685330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:01.685797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:01.686305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:01.687223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=055d2557c42448e8a7321e920d3e8eb3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:01.687530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:01.689020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:01.696316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 219/434] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:02:01 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=055d2557c42448e8a7321e920d3e8eb3&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:01.727574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 216/435] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:02:01.865709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:01.931099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:01.979556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343f6d-1f9f-4371-8954-e601dc5c7f1f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.014437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.016421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.017055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.017329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.017596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.028425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:02.033712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:02.034602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 18:02:02.035447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:02.039584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 220/436] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:02.041490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.144701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ba88e-8430-41cd-8c7a-c134aa73e3ec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.171429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62ac5-76c7-4167-9bd1-55816c3a8ac9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.183109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.183881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.184164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.184672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.196212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.197092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a7e42b61-03b1-448d-be41-bcd81b84d567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:02.202411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:02.203313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 217/437] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:02.205142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9de01-82a6-45f3-8149-8e04fcc48a56 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.205852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9de01-82a6-45f3-8149-8e04fcc48a56 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.205852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9de01-82a6-45f3-8149-8e04fcc48a56 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.206843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 218/438] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:02.211871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9de01-82a6-45f3-8149-8e04fcc48a56 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.213593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.215138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.215417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.215750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.216485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:02.216833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.218230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fef70-29b9-4b2c-b7b6-73a57b1fad50 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.233418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 221/439] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:02.233418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.233418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.233762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.240639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.254835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:02.256081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:02.327877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 222/440] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:02.328726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.335611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9de01-82a6-45f3-8149-8e04fcc48a56 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.371731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.372420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.372707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.372959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.373615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:02.373899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.375272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.388559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 219/441] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:02.389661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.440002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00d66-ed57-4241-83a9-4fb41360689f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.451169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.469219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.476079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.476693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.477030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.477233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.491005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e667e-192a-4310-91c4-11010d927a9f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.525830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.526430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.527232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.527523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.548454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.551675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.596341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.597884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.656390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 223/442] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:02.657227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.670859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.674311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.695276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 220/443] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:02.696055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.758246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b034-b8a7-403b-a4cb-a8e4db278978 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.792935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.793445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19982f3-6a7a-491e-826d-19b31b918eb8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.793567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.793823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.794091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.803879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:02.808656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:02.809628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 224/444] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:02.812586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.826830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.827451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.827723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.828019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.829138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.830563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.832194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 221/445] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:02.832931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.881025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.887002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:02.917784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb52ca-4a1f-442d-8a88-b3c46f3498f8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.934983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e895-cee4-4f7d-b62d-b5325f2d0d62 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:02.953396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.953951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.954229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.954496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] PATH_INFO: `/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.955614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] RBAC: Authorizing `identity:get_project(project_id=2824d75c5b514c0dacffd09ee4e2eb05)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.957093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.958692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 225/446] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/projects/2824d75c5b514c0dacffd09ee4e2eb05 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:02.959444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:02.968800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:02.969397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:02.969671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:02.969937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:02.970586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:02.970951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:02.972357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:02.981888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 222/447] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:02.982593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.062236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eb9b7-73ea-4d1f-88d8-2f1e0a0d377c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.079491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd42a81-807b-4a77-be37-99eb800aa397 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.088141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.097387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.098015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.098292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.098564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.099692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.101167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.102880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 226/448] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.103475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.112163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.114460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.115091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.115364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.115631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] PATH_INFO: `/v3/groups/c7f86016999a456fa3c762d77fa1b473` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.116781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] RBAC: Authorizing `identity:get_group(group_id=c7f86016999a456fa3c762d77fa1b473)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.118301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.120004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 223/449] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:02:02 2022] GET /identity/v3/groups/c7f86016999a456fa3c762d77fa1b473 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.120716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.208046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee204-6775-4b9d-acb9-fe8c7bde92b2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.219112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddac5-c8c4-4037-b594-b27af6f32b7e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.244549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.245180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.246111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.246467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.253682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.254278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.254550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.254821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.255530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=f6b2f10d1614446281653edfc178a15f, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:03.255874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.257310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.263564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 224/450] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=f6b2f10d1614446281653edfc178a15f => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.264363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.312633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.340227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.341928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.351232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.383959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c5e9-e7b7-4c08-aea2-1b5788edf4b9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.423729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.424674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.424674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.424856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.425606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] RBAC: Adding query filter params (group.id=c7f86016999a456fa3c762d77fa1b473, role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=2824d75c5b514c0dacffd09ee4e2eb05) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:03.425883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.427328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.439910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 225/451] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/role_assignments?group.id=c7f86016999a456fa3c762d77fa1b473&scope.project.id=2824d75c5b514c0dacffd09ee4e2eb05&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.462902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 227/452] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:03.469929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.596043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445848e-af4d-45bd-9f86-e7dd95ecf7f9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.598470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.635766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.636446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.636725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.636992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] PATH_INFO: `/v3/projects/d43b876cd1ae41b495f576bc2ce22f96` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.638133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] RBAC: Authorizing `identity:get_project(project_id=d43b876cd1ae41b495f576bc2ce22f96)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.639625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.641389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 226/453] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/projects/d43b876cd1ae41b495f576bc2ce22f96 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.646972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.743290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc322-c44f-4e26-9d40-c7a3002c827b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.750786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:03.775909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.776548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.776846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.777243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] PATH_INFO: `/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.778551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] RBAC: Authorizing `identity:get_group(group_id=214ef00c1ec348a4ad2b102ce50b37ca)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.780108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5256b-328f-40e0-9c2a-71f1dc6b7181 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.781843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 228/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/groups/214ef00c1ec348a4ad2b102ce50b37ca => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:03.787673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:03.886995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156122-fbd2-4e01-8db8-1eb6b432ed53 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:03.921073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:03.921666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:03.921942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:03.922211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:03.922924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] RBAC: Adding query filter params (group.id=214ef00c1ec348a4ad2b102ce50b37ca, role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=d43b876cd1ae41b495f576bc2ce22f96) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:03.923233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:03.924686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3b49-6d4d-43df-80a4-6674767cde88 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:03.930324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 227/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 18:02:03 2022] GET /identity/v3/role_assignments?group.id=214ef00c1ec348a4ad2b102ce50b37ca&scope.project.id=d43b876cd1ae41b495f576bc2ce22f96&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:06.465540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1421db-08b1-4fdf-8148-1df3b86cb484 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.466503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1421db-08b1-4fdf-8148-1df3b86cb484 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.467006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1421db-08b1-4fdf-8148-1df3b86cb484 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.468787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 229/456] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:06.474422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75362-5634-4418-803d-e383a16a892e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.474846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75362-5634-4418-803d-e383a16a892e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.474940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75362-5634-4418-803d-e383a16a892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.478733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79bb0-b413-477a-9aca-3a9c549e4b89 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.479377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79bb0-b413-477a-9aca-3a9c549e4b89 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.479837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79bb0-b413-477a-9aca-3a9c549e4b89 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.481758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 230/457] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:06.486820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396ab4-54d7-4bd2-b9af-51daad43acd1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.487151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396ab4-54d7-4bd2-b9af-51daad43acd1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.487620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396ab4-54d7-4bd2-b9af-51daad43acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.503307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-90d75362-5634-4418-803d-e383a16a892e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:06.504532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-90d75362-5634-4418-803d-e383a16a892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:06.532838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a5396ab4-54d7-4bd2-b9af-51daad43acd1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:06.534045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a5396ab4-54d7-4bd2-b9af-51daad43acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:06.548222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:06.623894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 228/458] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:06.675236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 231/459] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:02:06.723052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37d46-6b4b-4bb5-ba57-d7985afb427c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.723364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37d46-6b4b-4bb5-ba57-d7985afb427c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.723593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37d46-6b4b-4bb5-ba57-d7985afb427c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.725229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 229/460] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:06.731133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:06.731416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:06.731689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:06.756871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:06.757982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:06.858041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 232/461] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:06.900202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c37d46-6b4b-4bb5-ba57-d7985afb427c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:06.990648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.044250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.075990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c37d46-6b4b-4bb5-ba57-d7985afb427c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.156463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.156987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238480cc-a8f9-44fe-969e-5f0e86951607 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.157728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.158202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.158756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.184758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.186542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.193621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.194255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.194532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.194802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.206940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.208581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:07.215538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:07.216568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:07.217413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:07.217413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.217413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:07.219583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 230/462] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:07.220715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:07.226257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:07.227185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:07.228056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:07.228056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.228056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:07.228056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 233/463] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:07.228721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.252337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.349104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8401-5199-4caf-99da-c37777f8e0f9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.350283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.367539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f23b75-9593-4c2b-abdc-1bdd61d319de None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.387877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.388959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.389336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.389727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.404460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.406053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.408544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.409361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.409783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.410216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.411005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:07.411450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.413153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:07.423393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:07.424490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:07.425358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:07.425358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:07.425358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:07.425358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 231/464] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:07.426321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.436877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 234/465] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:07.438053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.510018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.543967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32fd7-2692-4f94-a0d4-d1840ae696aa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.553754 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab57-2af0-4237-bb3e-46734b852c81 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.586580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.587195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.587470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.587742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.588411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:07.588743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.590176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.594057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.594885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.595350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.595832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.596684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:07.597297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.598848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f366c-5efa-4b3a-8389-acc025b2eb4d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.602578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 232/466] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:07.603309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.615443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 235/467] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:07.617085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026429-7151-4214-bf52-9220e6da68e4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.617560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026429-7151-4214-bf52-9220e6da68e4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.618020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026429-7151-4214-bf52-9220e6da68e4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.619422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 236/468] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:07.620890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc026429-7151-4214-bf52-9220e6da68e4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.633803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.726550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f13f04-6a89-4a84-a8b3-97dd2c0d5eaa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.729990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc026429-7151-4214-bf52-9220e6da68e4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:07.763975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:07.767233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.767875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.768154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.768427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.769070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.769827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:07.770518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.770812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.771296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.771709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.772503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:07.774115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520afe8c-2482-495d-9735-d8c83ab708aa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:07.894002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 237/469] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:07 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:07.894732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:07.918582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 233/470] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:07 2022] POST /identity/v3/users => generated 246 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:07.919938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2296b7-f3bf-4ecc-b3a1-9c71f08390dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:07.920221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2296b7-f3bf-4ecc-b3a1-9c71f08390dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:07.921350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2296b7-f3bf-4ecc-b3a1-9c71f08390dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:07.950423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7f2296b7-f3bf-4ecc-b3a1-9c71f08390dc None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:07.951988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7f2296b7-f3bf-4ecc-b3a1-9c71f08390dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:07.987374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:08.050192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5c803-da0d-41d9-ba9e-df88af3f101e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.063785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 234/471] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:08.063785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28a544-0ca9-4dbf-ab5e-d94b06f86786 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.063785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28a544-0ca9-4dbf-ab5e-d94b06f86786 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.063785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28a544-0ca9-4dbf-ab5e-d94b06f86786 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.063785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 235/472] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:08.067401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.067676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.067970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.092008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:08.093324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:08.097424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.098037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.098310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.098580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.099271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:08.100849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:08.173927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 236/473] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:08.226187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 238/474] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:07 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:08.345023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:08.408953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:08.465966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac488e-ccbc-402d-a17d-36f1330e8b8a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.513418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:08.513822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.514342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.514565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.514831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.528816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:08.531078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:08.554888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:08.565013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:08.565871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:08.565871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:08.565871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:08.565871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 237/475] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:08.566292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:08.653868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38ccb4-0d40-4887-b5ba-e2d1207b9ccf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.683148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:08.687594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2c6cf-172f-4f17-9ca8-3200a7b43214 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.688146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:08.698362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.699334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.699615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.699920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.705385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:08.705385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:08.734080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.734583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.734860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.735130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.736425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:08.736425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:08.737605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:08.746948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.sql.core [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 18:02:08.746948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 18:02:08.746948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [parameters: {'id': '4004931060b84bfca784f26a37ada132', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 18:02:08.746948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 18:02:08.753088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 238/476] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:08.759212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:02:08.767237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:02:08.768184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application yield resource Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise self.value Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application session.commit() Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 18:02:08.769085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.flush() Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application compat.raise_( Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 18:02:08.769933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:02:08.770827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:02:08.771651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [parameters: {'id': '4004931060b84bfca784f26a37ada132', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:08.777567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 18:02:08.779622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.781600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 239/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 18:02:08 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:08.786873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:08.877133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55150e-abfd-4f4e-a058-a40b51a28942 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.905259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f89ca-f09b-4a22-9f7b-92b0f8fbea15 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:08.913313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.914091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.914199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.914460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.915094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:08.916852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ea60-ccc1-4bb0-9f43-a2d039836ee2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:08.944843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:08.945841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:08.946315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:08.946796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:08.959697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:08.967623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:08.968728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 18:02:08.969745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:08.972075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 240/478] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:08.977916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:09.024604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 239/479] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:08 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:02:09.027210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:09.092871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344954-31a1-40db-a283-c55f146b1e13 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:09.144759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:09.145386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:09.145661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:09.145929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:09.146610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:09.146907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:09.148352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d7f3-88d3-4550-b920-9b460130d0e1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:09.165178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 241/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:10.119265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa68c-1b7d-45a4-ba14-85b4bc17a794 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:10.120847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa68c-1b7d-45a4-ba14-85b4bc17a794 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:10.121368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa68c-1b7d-45a4-ba14-85b4bc17a794 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:10.123356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 240/481] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:10.128689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084a95-4608-4043-a417-886b0a789715 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:10.129597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084a95-4608-4043-a417-886b0a789715 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:10.130068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084a95-4608-4043-a417-886b0a789715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:10.156738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-12084a95-4608-4043-a417-886b0a789715 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:10.158300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-12084a95-4608-4043-a417-886b0a789715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:10.254611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 242/482] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:10.404039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b268c9-5bc7-40c3-8f9c-4b2d9dd7fcf7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:10.404222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b268c9-5bc7-40c3-8f9c-4b2d9dd7fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:10.404486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b268c9-5bc7-40c3-8f9c-4b2d9dd7fcf7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:10.406083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 241/483] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:10.411322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:10.411610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:10.411911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:10.440818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:10.442010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:10.482387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:10.540687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 243/484] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:10.804780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b268c9-5bc7-40c3-8f9c-4b2d9dd7fcf7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:10.824947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:10.927236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b268c9-5bc7-40c3-8f9c-4b2d9dd7fcf7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:10.962502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:10.963128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:10.963402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:10.963667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:10.973996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:10.978680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:10.979889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:10.980684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 242/485] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:10.981326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:10.988757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.133636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.138615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89d017-056a-4d20-8221-c1a4adace36c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.159885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27006e-df25-4691-a38c-6e0a841edbff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.175678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.176661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.177142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.177598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.188312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7700025e-e667-494a-a70b-c77e5dddab9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:11.193196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:11.194066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:11.194833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:11.197730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 244/486] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:11.200600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8c32a-1690-4d10-b53b-af235930c3dc None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.201052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8c32a-1690-4d10-b53b-af235930c3dc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.201484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8c32a-1690-4d10-b53b-af235930c3dc None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.203171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 245/487] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:11.204412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8c32a-1690-4d10-b53b-af235930c3dc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.206719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.207823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.208228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.208571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.210351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:11.210725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:11.212235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445b91-f788-4233-bb6a-df2401f818fb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:11.231810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 243/488] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:11.238333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.238623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.238960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.245154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.261848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:11.263100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:11.350349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8c32a-1690-4d10-b53b-af235930c3dc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.356829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 244/489] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:11.356829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.433760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.452657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.455271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.455271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.455271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.455271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:11.455271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:11.457439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:11.474365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 246/490] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:11.482005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.484782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2c8f-2e51-497f-aaee-faa3edf4552b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.537693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.538331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.538855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.539129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.551904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:11.553594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-435af50f-589f-406d-b4c2-1c5b769dcaab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:11.568937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:11.569827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:11.570669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:11.570669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:11.570669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:11.570669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 245/491] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:11.571730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe964de-44b5-4c31-b016-6439002c3439 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.571730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe964de-44b5-4c31-b016-6439002c3439 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.571929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe964de-44b5-4c31-b016-6439002c3439 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.577636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 246/492] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:11.577636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63cf6-e401-4303-9702-7634f8f96f4f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.577636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63cf6-e401-4303-9702-7634f8f96f4f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.577636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63cf6-e401-4303-9702-7634f8f96f4f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.577636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 247/493] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:11.578010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63cf6-e401-4303-9702-7634f8f96f4f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.591546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.607650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccfb7c-bf55-4328-85ea-ae91886b3c9d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.642567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.643275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.643776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.644042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.655541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:11.657155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-059eaa2d-a892-44d4-83ad-6e7d9c353dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:11.673077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:11.674084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:11.675613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:11.675613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:11.675613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:11.675613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 247/494] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:11.675613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.676159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.676159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.685593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63cf6-e401-4303-9702-7634f8f96f4f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.694611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:11.695824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:11.702917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.720514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.721116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.721392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.721663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.722299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:11.722675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:11.724015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236037d-6299-4f57-88d3-f848053ba2b2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:11.737206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 248/495] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:11.738502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.738838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.739176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.756312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:11.757520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:11.762640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 248/496] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:11.775939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.826781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 249/497] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:11.827619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.850472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:11.889220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b480-9c12-41fc-a930-620d3af93a8d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.931186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:11.931941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:11.932288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:11.932645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:11.945563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:11.952790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:11.953838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:11.954825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:11.956344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 249/498] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:11.957213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e65c13-60a0-48e0-a978-e7067a74e29e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:11.957328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:11.968575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.004045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.005169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.006495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.006911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.007695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.008152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.009811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.029643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 250/499] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.031286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.086542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363383ab-a6da-425e-b31e-a820566d11aa None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.115411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.123412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.124089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.132681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.132681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.132681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.133447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.139425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe175fd-d91a-4af7-8a7b-37adee141733 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:12.146664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:12.148254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 250/500] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:12.149331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.176358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.177773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.177773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.177773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.178111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.178402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.179779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.188396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 251/501] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.189164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.219496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.260037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002db26-423d-45f1-9e4e-53733bf0f97f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.291265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0fa54-dd2d-4498-973c-cfea5d78851e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.293812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.294441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.294718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.294989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.302578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.304074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:12.315479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:12.316538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 251/502] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:12.317395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.328887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.329508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.329778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.330046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.341101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.342531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:12.357835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:12.358903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:12.359780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:12.359780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:12.359780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:12.359780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 252/503] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:12.359780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.367153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.421881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f964c0-1466-4ef3-925b-44f7e2728836 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.442195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.455862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.456498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.456773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.457039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.460111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41fb14-e136-4d1c-a135-23127ce8573d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.467430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:12.472709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:12.473591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:12.474394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 252/504] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:12.475039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.494601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.495906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.496155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.496424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.497146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.497445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.498876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.535294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 253/505] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.536154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.579665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cf6bd-fa81-42d4-9e64-5f6f7b17a74d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.588893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.614205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.614833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.615110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.615381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.627193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.628701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.637953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1708a-4105-43eb-b30e-fe9f60afcecc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:12.643131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:12.644194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:12.645242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:12.645242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:12.645242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:12.647897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 253/506] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:12.649154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.672111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.672719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.672999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.673275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.674003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.674312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.675743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.684834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.693613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 254/507] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.694456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.749024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88949165-de58-40c3-aad1-8a1ad03ac1b5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.782297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.783144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.783144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.783499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.784172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.784471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.785853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.792437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d737-df93-4fe4-a965-55983ad6eea6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.797761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 254/508] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.798556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.819223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.830149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.830748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.831023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 255/509] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.845213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:12.899555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0a60-2502-435d-b72f-56bf4a05561f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.904885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:12.935764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.936388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.936664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.936931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.944562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065646c5-8243-4c0e-a983-04e92fc0cbb1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:12.977544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:12.978142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:12.978416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:12.978682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:12.979716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:12.980118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:12.981512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:12.992947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 256/510] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:12.993751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.003399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.004735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.025044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.093135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b92af-c89e-413d-9d2a-9ca2d7d51449 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.104363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 255/511] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:13.105184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.113916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.127653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.133224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.133224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.133224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.196727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.198911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.202820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eec37-06a0-4565-82ee-17381bba840f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.224352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.239915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.240527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.240809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.241081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.241723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.243179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.310466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 257/512] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:13.311271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.323931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 256/513] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:13 2022] POST /identity/v3/users => generated 247 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:13.324984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.335817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.427639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3514e6-c6a5-4ffb-acfd-b00b61d10544 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.457909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868cee-e269-425e-8fba-90bea79a0a1b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.465208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.465812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.466090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.466359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.477834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.479657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:13.497370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:13.498577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:13.500913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:13.500913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.500913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:13.500913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 258/514] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:13.500913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.501172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.501172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.501334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.501619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.511892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.513779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:13.527643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:13.528595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:13.529478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 257/515] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:13.530023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.569457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.592737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.624867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84873c-aa46-4685-8db1-a202738666c6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.634831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ba8-91e2-427c-a8d3-e1906aad5d88 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.660989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.661618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.661899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.662167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.670593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.671218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.671491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.671778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.674404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.676014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.683139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.684621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:13.691004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:13.691917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:13.692792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:13.692792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.692792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:13.692792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 259/516] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:13.693219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:13.704341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:13.705277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:13.706234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:13.706234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:13.706234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:13.711791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 258/517] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:13.711791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.810334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.812170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a76455-2a8b-42b3-9f8a-eb31f9963c91 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.824174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fbde2-3a14-4f53-bfdf-e81f1d0ff5a0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:13.837779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:13.848311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.848948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.849222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.849523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.850113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:13.850408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.851775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.859211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:13.859840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:13.860120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:13.860388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:13.861184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:13.861490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:13.862915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:13.869429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 260/518] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:13.869429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.909963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 259/519] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:13.909963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:13.972019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8a7ff-54ed-409c-8404-84be6635830e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.009369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.009974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.010244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.010510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.011288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29495c9-15f6-4208-9472-3d2507e447d5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.011676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:14.012163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.013563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.025653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 261/520] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:14.030917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.049729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.050377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.050633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.050901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.051535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:14.051861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.053230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.069079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 260/521] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:14.069079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.077843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.082909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.145852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a313e8-7fbd-4bd8-a3de-fbced229c43d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.174952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72664e5-3feb-4ca7-93cf-558898a41e62 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.178606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.179295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.179636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.179993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.187749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.189286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:14.203971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:14.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 262/522] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:14.206683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.217753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.218400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.218632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.218900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.302963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.304809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.314842 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883ddc4-d671-4331-9f80-0d8b45a6bcdf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.317401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.317909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.352277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.353170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.353448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.353716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.361663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.363130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:14.376666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:14.377691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:14.378699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:14.382594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 263/523] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:14.383445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.415492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 261/524] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:14.416386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.497123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44de17-0dc3-4e7c-866d-cdd3733dc000 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.523239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883e541-88e7-46ee-a7fc-0a4dd06240b9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.531296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.539920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.542949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.542949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.542949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.549926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.551385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.558189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.559042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.559490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.560061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.561019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:14.561543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.563175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:14.563287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:14.564090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:14.564993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:14.565982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 264/525] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:14.566223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.591573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 262/526] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:14.591573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.598064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.673354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f853-1412-4c9e-93ba-4360d6491f43 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.704865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff119e-8e0a-4ebe-abb6-8cd9f306dce2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.713563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.714254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.714912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.715039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.715619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:14.715947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.717442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.735676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 265/527] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:14.736499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.745617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.746281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.746559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.746828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.757435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.758882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:14.774455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:14.775366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:14.776633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:14.776633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:14.776633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:14.780313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 263/528] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:14.781173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.800362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.827016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:14.845165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec98b-e3f4-4039-8963-da322fc16f57 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.881862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.882467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.882742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.883009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.883692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:14.884027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.885463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:14.886783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582ec47-3ce4-4815-b752-8afbdd9b2315 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:14.898472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 266/529] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:14.904335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:14.923196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:14.923875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:14.924098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:14.924367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:14.992516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:14.993970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.010061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a351f79-5fe9-43d8-88d4-b38d28f48c8f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.012568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.046163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.046761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.047037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.047303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.048078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:15.048384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.049936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.064148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 267/530] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:15.064148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.082966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.112299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 264/531] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:15.113186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.217242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7f7d3-62b8-4f68-bf53-9d4d121bf643 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.230708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70080-6680-4c7d-ae3e-9b84ff5c462e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.251575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.266885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.267504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.267920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.268196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.269116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:15.269422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.271437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.274734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.275621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.276809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.277295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.278358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=69f48db1a2504c9f80ceead1166e374a) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:15.278858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.280510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.291413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 268/532] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:15.292335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.292702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 265/533] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/role_assignments?user.id=69f48db1a2504c9f80ceead1166e374a&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:15.293841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.377535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.412502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039d2a-aa1d-4bc6-bd7a-0a3959b45189 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.437904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b344-7200-423d-92c6-ca281de565e3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.452439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.453091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.453467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.453741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.469843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.471651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.488333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd973bb9-e120-45c1-a6f1-a712d6e2fb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:15.488740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:15.489602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:15.490421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:15.490421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:15.490421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:15.490421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 269/534] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:15.491018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d2b3-c652-49dc-882c-68bb657cbfb1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.491277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d2b3-c652-49dc-882c-68bb657cbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.491547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d2b3-c652-49dc-882c-68bb657cbfb1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.492192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.492654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.493087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 270/535] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:15.493254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.495226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d2b3-c652-49dc-882c-68bb657cbfb1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.508619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.511565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-47d0a8b2-fa76-4fcb-9e06-46b5c7c3234c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:15.528965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:15.529867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:15.530714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:15.538445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 266/536] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:15.540068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.540576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.541164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.560984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:15.562554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:15.618156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d2b3-c652-49dc-882c-68bb657cbfb1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.626363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.641449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:15.651444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 267/537] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:15.651444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.677583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.678253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.679434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.679720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.680419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:15.680720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.685609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.716134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 271/538] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:15.717599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.825747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc8e2f-453e-43cb-8261-0530ca283cb5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.871250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8e9d-5b00-44b0-bb4a-1d55d3a08fa8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:15.889780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.890382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.890655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.890920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.891613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:15.891937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.893373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.931385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 268/539] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:15.938332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.948750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:15.949451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:15.949726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:15.950040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:15.957882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:15.959331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:15.971874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:15.972749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:15.973587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 272/540] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:15.974039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:15.976266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:16.036148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:16.050980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96821b1-bafe-47db-84b0-174a8210b707 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.086554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.087388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.087858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.088316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.089889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=1a4fb108a9e6494f8465dc2e86911ff1) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:16.090383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.092072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.092370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aae8e7-9613-4a81-a69e-8f1afedac35f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.103874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 269/541] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/role_assignments?user.id=1a4fb108a9e6494f8465dc2e86911ff1&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:16.105516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.134960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.135670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.135984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.136252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.160507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:16.169986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:16.170993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:16.171801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:16.175081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 273/542] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:16.177278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.315440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:16.342391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa976dc-2163-4170-8642-28ab8bd2862b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.368131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:16.370942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3dda-bdd1-4910-b53b-47dfda0a9de3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.414341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.414945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.415217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.415553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.416185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:16.416484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.417966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.432296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.432949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.433222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.433490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.434782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:16.435076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.437081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.445993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 274/543] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:16.446463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 270/544] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:16.452449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.452568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.600522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46423b48-9f3c-4448-ab14-051709e6a81c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.641066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.641670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.641942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.642205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.643137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=c637175771de4971a667a9687cfb7e3c) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:16.643439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.644923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.652033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 271/545] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/role_assignments?user.id=c637175771de4971a667a9687cfb7e3c&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:16.676413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c29e9f-e043-4987-90ea-c2ddaa1fbf9a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.730928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.731589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.731904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.732175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.744153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.746213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:16.762813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:16.763785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:16.764642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:16.764642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:16.764642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:16.764642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 275/546] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:16.770102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.804991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:16.905114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f846f-de8a-44c9-a606-238c5a4cce73 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:16.940073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:16.940715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:16.940987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:16.941303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:16.941943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:16.942237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:16.943591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:16.955416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 272/547] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:16.960897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:16.990826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:17.116520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d1e96-9ceb-45d5-a660-aa059c81b778 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:17.152509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:17.153139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.153414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.153679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.161902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:17.163281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:17.175430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:17.176549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:17.177455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:17.181234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 276/548] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:17.184861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:17.308273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:17.330465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da79524-bb0f-46da-bf54-422e7f988f19 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:17.367147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:17.367768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.368059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.368326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.369049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:17.369349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:17.370855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d2c6d-7aab-438f-9af2-78ad576246e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:17.390319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 273/549] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:17.396175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:17.408154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edae349-86b0-401f-a97d-423d7cfbc3ef None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.408500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edae349-86b0-401f-a97d-423d7cfbc3ef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.408686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edae349-86b0-401f-a97d-423d7cfbc3ef None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.410226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 274/550] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:17.416989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fea-6a81-4f95-b6d2-27c992819a55 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.417306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fea-6a81-4f95-b6d2-27c992819a55 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.417544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827fea-6a81-4f95-b6d2-27c992819a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.445451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5d827fea-6a81-4f95-b6d2-27c992819a55 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:17.446687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5d827fea-6a81-4f95-b6d2-27c992819a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:17.515425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 275/551] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:17.533244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:17.558572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d06c6-0e3a-4116-a3d4-a004e88670de None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:17.593638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:17.594247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.594523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.594792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.665085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:17.666550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:17.677525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728228cd-af8f-4da3-9654-eca0dfe563d9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.677786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728228cd-af8f-4da3-9654-eca0dfe563d9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.677999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728228cd-af8f-4da3-9654-eca0dfe563d9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.679576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 276/552] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:17.689005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.689360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.689637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.751505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:17.752792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:17.760246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:17.775302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 277/553] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:17.776715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:17.860753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:17.868888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 277/554] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:17.870486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:17.897083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e0e2-0cb8-4422-ad50-66375703d6b3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:17.947301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:17.951546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:17.951546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:17.951546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:17.972872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:17.974335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:18.000502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:18.001666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:18.002728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:18.002728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:18.002728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:18.006943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 278/555] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:18.011981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.014457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70edda-8fe3-47be-ba17-19102af2e41b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.071826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.084203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.084831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.085102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.085366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.107992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:18.112619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:18.113700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:18.114707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:18.115491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 278/556] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:18.122303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.196790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90aeb3-f8fd-441b-8c53-b82dae05258e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.209952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.251708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.252913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.253417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.254246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.255089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:18.255589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.257860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.270039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c7296-e1d4-4c30-9274-54197d0fe36e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.278534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 279/557] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:18.279717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.308542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.309216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.312066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.312066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.312066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:18.312066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.312396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.321361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 279/558] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:18.322351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.374505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.390432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3ba86-751b-4ddb-a3a4-91b2d1e94363 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.427296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.427964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed38e-aadc-4161-bea7-5e063345691d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.428338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.428338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.428477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.439711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:18.444442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:18.445801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:18.446623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 280/559] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:18.447301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.451317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.474163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.475016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.475302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.475860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.484177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.485643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2bf08afe-0937-4b09-a17c-14ef7779d2cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:18.498101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:18.499187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:18.500385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:18.502110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 280/560] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:18.503398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb928a-69ea-46eb-a656-e814ea88e0e6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.503834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb928a-69ea-46eb-a656-e814ea88e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.504234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb928a-69ea-46eb-a656-e814ea88e0e6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.505598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 281/561] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:18.506434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb928a-69ea-46eb-a656-e814ea88e0e6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.558297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557910-c44c-49bc-a5a5-687f7f710fb9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.593286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.593916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.594194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.594465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.605408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.606868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.613491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:18.622000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:18.625228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:18.626436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:18.626436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:18.626436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:18.626436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 281/562] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:18.626436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.664404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb928a-69ea-46eb-a656-e814ea88e0e6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.700130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.700733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.701076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.701349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.702024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:18.702331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.703717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858380e4-668c-4ff1-bb6a-c9c62716304d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.711829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 282/563] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:18.712996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.713276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.713584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.732260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:18.733389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:18.740445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568a4e-d5bd-4b63-ac46-7eb0e1b8db37 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.770289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.776934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.777553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.777830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.778173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.778870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:18.779179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.780649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.794384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 282/564] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:18.795228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.809833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 283/565] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:18.811008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.875881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:18.921434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c544f-d85d-4724-9842-2e05ca86758e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.934757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb527-4439-49ce-880f-c7dc10e70006 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:18.959887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.960492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.960810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.961026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.961672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:18.961944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.963305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:18.970011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:18.971024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:18.971024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:18.971274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:18.981545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 283/566] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:18.981545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:18.986539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:18.988084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-42a49463-d80e-4899-9dd6-8fa777c9cb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:19.004913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.005885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:19.006760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:19.006760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:19.006760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:19.006760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 284/567] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.007481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81eea9-69d7-4b78-91e3-b9c19e1099d6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.007579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81eea9-69d7-4b78-91e3-b9c19e1099d6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.007872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81eea9-69d7-4b78-91e3-b9c19e1099d6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.012302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 285/568] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:19.013693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81eea9-69d7-4b78-91e3-b9c19e1099d6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.040338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.092206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a1559-4cd3-45d4-a3fb-905798e4d103 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.111032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.123820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81eea9-69d7-4b78-91e3-b9c19e1099d6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.128289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.128918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.129197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.129466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.130180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=ab64f273e7554c40b7d7eac5f59eb3e7) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:19.130483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.131943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.137447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 284/569] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:18 2022] GET /identity/v3/role_assignments?user.id=ab64f273e7554c40b7d7eac5f59eb3e7&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:19.138230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.162289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.163063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.163341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.163618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.173394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.175128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-65cfb1a8-3980-42ae-82e5-34a56a6ef197 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:19.188757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.189803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:19.190725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 286/570] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.191316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.191929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.191929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.212617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:19.214681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:19.269416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d1aa-d687-461f-a98b-2f1de3ae5ba5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.298718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 287/571] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:19.299573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.313848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.314546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.314894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.315237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.316007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:19.316401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.316716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.318396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.332262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 285/572] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:19.337499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.389031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.431684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254639-22de-4924-89fc-5c548bea5c00 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.451522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c1c0c-7322-40bd-b32f-7d00d6684913 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.478258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.480726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.481183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.481864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.492049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.492894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.493378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.494074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.494442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:19.495807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:19.496302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.498003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:19.500274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.501193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:19.502081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 288/573] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.502768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.527658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 286/574] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:19.529079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.583404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.622570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b6370-67bf-4a4d-a661-1f96a3d55a66 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.646429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.649521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913591-c3e1-4beb-81ae-3441c039b19b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.660199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.660830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.661101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.661367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.669461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.670916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:19.683402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.684476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 289/575] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.685392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.693151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.693933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.694350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.694760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.695582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:19.695915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.697269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.706597 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 287/576] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:19.707412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.800246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ede8cc-1e0f-4e12-9cb1-2d37c0b481fa None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.819030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065d94c-2912-4e7b-8136-3587846d49b9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.833045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.838353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.839149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.839431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.839703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.850455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:19.851921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:19.855412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:19.856371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:19.856879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:19.857345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:19.866354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.867480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:19.868601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:19.868601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:19.868601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:19.871895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:19.874828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 290/577] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.875673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:19.877626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:19.878707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:19.879654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:19.880941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 288/578] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:19.881707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:19.910578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:19.982250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02648b-db6e-4359-ac20-3788303f3989 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:19.994522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ccf-bb74-4ac6-b1ef-f816ca4c8a6f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.018129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.018736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.019013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.019286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.020042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.020344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.021774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.030401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.031095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.031372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.031637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.039628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 291/579] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.040634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.047780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.050134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:20.071869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:20.072874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:20.073773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:20.073773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.073773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:20.073773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 289/580] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:20.074556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.095359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.157527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208f52-2199-486b-80c6-5f520a6325b8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.159220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.185100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb4d8-610f-447d-9dec-28916eddcac5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.194713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.195326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.195606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.195909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.196554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.196855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.199517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.212321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 292/581] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.213200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.231077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.232018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.232501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.232949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.233789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.234265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.235869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.250052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 290/582] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.250052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.341639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c73b-4b34-49eb-9650-fb411b90ac01 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.343985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.351612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7c09c-e8ee-4e54-8151-9b2658df057e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.381661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.382522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.382798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.383072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.389354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.390182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.390640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.390904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.391532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.391855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.393358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.394663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.396022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.396404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.408616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 291/583] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.411874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:20.411978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:20.412848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:20.413722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:20.413722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.413722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:20.413722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 293/584] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:20.414237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.523249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7f9d-536f-46af-b98d-a945ef327b88 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.524446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5b751-aab2-44f6-a1f8-c171687f3ed0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.559699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.560365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.562426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.562426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.566384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.567214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.567662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.568160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.572486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.574675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.576422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.578042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:20.589042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:20.595627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:20.596722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:20.596722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:20.596722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:20.596927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:20.597881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:20.598933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:20.599448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 294/585] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:20.599448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.599602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 292/586] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:20.599602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.619402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.669244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.715969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a6c44-fc7b-4af0-b79a-38dfaf35d50f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.718489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1802-0c84-42f1-826b-98d5a71e0a74 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.750725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.751437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.751715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.752135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.752769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.753064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.754400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.754516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.755171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.755447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.755720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.763962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.765403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.771051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 293/587] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.771051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:20.781162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:20.782145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 295/588] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:20.783190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.853545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.875613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3e37-bbbb-4728-8c12-d49dfa6f3525 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.889755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf533f-cd5a-4fba-ae05-4b8e7cacdefd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:20.894147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:20.913760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.914514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.914798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.915069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.915708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.916037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.918044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.925476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:20.926259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:20.926687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:20.926955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:20.927640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:20.927964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:20.929376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:20.935204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 294/589] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.935204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:20.952367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 296/590] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:20.953153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.049046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b70d50-c19c-4eb8-b0fa-80933dc214f8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.056253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2c5ef-4c2a-428f-9973-a5b747183190 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.082413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.083041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.083311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.083412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.083579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.090214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.091662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.094867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.094867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.094867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.094867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.095266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:21.095266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.095746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:21.102797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:21.103693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 295/591] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:21.105995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.118971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 297/592] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:21.120366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.142751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.207457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b4205-baab-4f65-8f54-34034b3cbc93 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.220196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ed682-8131-477c-819b-f4e7ddbee311 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.242678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.243299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.243568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.243862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.251430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.252997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.257810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.258461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.258735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.259002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6795f983-70d8-4735-822f-fe2daa1abcd3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:21.264734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:21.270385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 296/593] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3072-98ad-43df-9d89-6ce9ba31c3b7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.271624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3072-98ad-43df-9d89-6ce9ba31c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.272537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3072-98ad-43df-9d89-6ce9ba31c3b7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.272537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 297/594] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:21.272537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f3072-98ad-43df-9d89-6ce9ba31c3b7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.279672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=f66707e00ece419d9cc33f09ba016e6f, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.281149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.364815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.373932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f3072-98ad-43df-9d89-6ce9ba31c3b7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.376554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 298/595] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:21 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:21.377380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.417209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.419433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.420114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.420397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.420670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.421381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:21.421688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.423230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.443684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 298/596] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:21.443684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.500570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e629-2124-4e34-a4a8-689e021b928f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.545405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.546303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.546585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.546856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.558218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.559711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.562620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30072d-a9e3-4d46-8f2a-b8cbc1e3b6f8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4fbd341f-9f03-41e5-84f6-54777c01ec5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:21.575876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:21.576913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:21.577812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:21.577812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:21.577812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:21.577812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 299/597] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:21.578456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.578456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.578864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.597368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:21.598559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:21.607342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.608330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.608793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.609752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.611075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:21.611888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.613802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.632865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 299/598] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:21.633907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.653082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.683439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 300/599] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:21.685162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.708526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.779835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd429c9-c40a-4084-b7e0-67f6ef3451e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.796931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5bf18-593a-410f-af89-d68366b31889 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:21.818528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.819516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.820030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.820484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/69f48db1a2504c9f80ceead1166e374a/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.835087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:21.835501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:21.835815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:21.836090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:21.836787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:21.837154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.838486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.840376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=69f48db1a2504c9f80ceead1166e374a, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:21.842269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:21.850633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 301/600] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:21.851290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.925572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 300/601] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:21 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/69f48db1a2504c9f80ceead1166e374a/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:21.926495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:21.945068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:21.977605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6bc19-aff0-483b-85b2-dbcaff050d24 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.045808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.047081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.048190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.048704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.049415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.069843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.072993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.099097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f78f-6426-4d9c-a760-3f90d64673e6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:22.099511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:22.100443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:22.101583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:22.101583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:22.101583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:22.102140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 302/602] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:22.102760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.150287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.151900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.152495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.153555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.163374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.165548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:22.182701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:22.183607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:22.184539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:22.185869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 301/603] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:22.186088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.228719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c697-7d88-451e-8d68-41e0a0f00939 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.263191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.272386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.273291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.273573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.273852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.288962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:22.295244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:22.296312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:22.297293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 303/604] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:22.298041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.331539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c6d49-3667-44e3-b8ff-dd3a14371d28 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.358026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.370078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.370871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.371423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.371704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.372476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:22.372875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.374340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.388354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 302/605] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:22.389641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.423271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2c41e-05cb-4578-8227-d1bd9aeff083 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.464143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.465256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.465635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.466259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.467063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:22.467466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.469224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.486532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 304/606] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:22.487865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.514912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c4e82-369e-4026-8dbc-b119018543c8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.554798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.555645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.556199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.556362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.556794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.558255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:22.558701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.560266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.569390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 303/607] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:22.570375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.617030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a01b-f84b-47dc-b56d-40be9403f9b2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.639381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.668388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.670176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.670645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.671059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.680076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.683129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:22.697463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:22.698429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:22.699391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:22.703178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 305/608] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:22.704676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.723661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd672d51-95ce-4b5e-9ba6-27ad9922fbe0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.781017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.782660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.783053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.783404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/1a4fb108a9e6494f8465dc2e86911ff1/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.808981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=1a4fb108a9e6494f8465dc2e86911ff1, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.811334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.862180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fcf39-ed1e-43af-84fa-2428335761ed None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:22.873491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:22.903741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:22.904487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:22.904768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:22.905066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:22.917646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:22.920381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:22.941004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:22.942004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:22.942942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:22.942942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:22.942942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:22.942942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 306/610] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:22.943704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:22.944116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 304/610] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:22 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/1a4fb108a9e6494f8465dc2e86911ff1/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:22.950993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:23.090838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:23.098827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250339d5-f604-4179-82aa-4c54ea111708 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.151444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.153331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.153982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.154687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.155551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:23.156039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.158011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.175788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 305/611] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:23.185276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:23.212886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5ec0-58ea-451f-bc28-5062cc1e9b62 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.259795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.260889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.261739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.262171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.263347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:23.263857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.265683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.285987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 307/612] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:23.294234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:23.327503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:23.363862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bcb6-299a-407e-9dec-094aecf99f92 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.406307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.408187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.408696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.409134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.421033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.422727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:23.440763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:23.442062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:23.443231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:23.445639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 306/613] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:23.453240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d238-fc98-4567-8f0a-48bcb86463e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.455963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:23.500175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:23.531169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.531870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.532260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.532535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/c637175771de4971a667a9687cfb7e3c/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.558038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=c637175771de4971a667a9687cfb7e3c, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.559896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3f57-3584-4972-81ab-f7546c1b0c2b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.618853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81ba0-49ae-407a-b177-cbfadd7525e4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.639567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 308/614] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:23 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/c637175771de4971a667a9687cfb7e3c/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:02:23.642423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa8cf-1513-4443-801d-2f1048ce43e1 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.643038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa8cf-1513-4443-801d-2f1048ce43e1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.643630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa8cf-1513-4443-801d-2f1048ce43e1 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.647151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 309/615] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:23.655789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.656307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.656935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.675783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.679441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.679785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.680058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.682906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:23.684050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.686323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.700817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:23.702060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:23.731162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 307/616] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:23.737176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:23.832673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 310/617] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:02:23.833999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:23.851709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:23.879626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0af54-9a99-4256-a32b-69fd8da1bcb2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:23.915684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:23.916360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:23.916681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:23.916974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:23.934568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:23.936063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:23.956516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:23.957531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:23.958969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:23.958969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:23.958969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:23.958969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 308/618] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:23.963280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.120233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bfede-6444-43ba-9158-81d694ad45cf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.146691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.174697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.175320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.175590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.175890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.176537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:24.176832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.178204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:24.190793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 311/619] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:24.200854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.268337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:24.291261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f50fa-7ff7-42b3-ae75-baf6366e4189 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.313340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e78-d568-4eb5-a461-0d5c5b542bc2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.321432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:24.330108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.333697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.333697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.333697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.347381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:24.351264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.352133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bf8ce318-974b-4823-85ef-5f1a6496b705 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:24.352415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:24.353496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:24.354843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:24.356079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 309/620] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:24.356474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.356968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.357115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8903c9-d602-4cfa-94f9-4afb228668ff None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.357450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8903c9-d602-4cfa-94f9-4afb228668ff None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.357782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8903c9-d602-4cfa-94f9-4afb228668ff None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.359326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 310/621] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:24.367274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.367544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.371503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.371650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.371650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:24.383485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:24.384457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:24.385645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 312/622] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:24.386599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.390191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:24.391622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:24.488245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 311/623] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:24.488245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.509908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b3b9-7682-44d9-9e54-8ff46dc93416 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.548447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:24.576853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.577462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.577716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.577985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.578650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:24.578949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.580434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:24.595062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 313/624] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:24.600774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.680067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d864c3-d1e4-486a-b8f6-c860ceaed0e8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.709172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:24.745799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.746346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.746626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.746896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.747592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:24.747944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.749388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:24.773547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be952b9-41e2-4575-be52-c4a8a4f26e18 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.775012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 312/625] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:24.776935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.830207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.830836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.831165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.831438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.842635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.844192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:24.859537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:24.860687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:24.861884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:24.861884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:24.861884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:24.861884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 314/626] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:24.861884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:24.906416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:24.919364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3995ca7-c8fb-4c08-9bb1-c19d769785c7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.958512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:24.959177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:24.959705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:24.960023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/ab64f273e7554c40b7d7eac5f59eb3e7/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:24.976550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861c4a9-f269-4096-9f7d-c6273ebc8f1d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:24.980725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=ab64f273e7554c40b7d7eac5f59eb3e7, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:24.982330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.015207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.015779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.016066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.016328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.028881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:25.033665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:25.036656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 315/627] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:25.037480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.080386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 313/628] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:24 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/ab64f273e7554c40b7d7eac5f59eb3e7/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:25.082552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.180183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.218999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8fee-2e83-4f46-8f77-2b76d5088051 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.223986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.247538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5b85-38a3-40c3-b358-f248f16191bf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.272112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.272809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.272921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.273202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.275944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:25.276313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.278158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.288505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 314/629] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:25.295298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.333690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.334683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.335406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.336772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.337627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:25.338143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.340030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.356497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 316/630] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:25.363987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.410628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.425446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcffc-8241-4556-8c5b-92fc42129bc7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.471298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.471963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.472270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.472965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.487247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.489393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.501915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab206ad-bcf4-430b-98dd-91b673a1271d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e248a921-822e-4be0-a922-0fce9110ff3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:25.506895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:25.508047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:25.509141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:25.509141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:25.509141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:25.511777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 315/631] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:25.516135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918902f7-d3e1-49c7-877e-e8d9c53df7ed None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.516413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918902f7-d3e1-49c7-877e-e8d9c53df7ed None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.516683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918902f7-d3e1-49c7-877e-e8d9c53df7ed None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.518233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 316/632] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:25.518948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918902f7-d3e1-49c7-877e-e8d9c53df7ed None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.540286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.540941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.541262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.542128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.550879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.552543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d3bfa5c0-8e97-4e77-a5b3-038ab35b93ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:25.565235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:25.567417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:25.569683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 317/633] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:25.579483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.579483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.579483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.595142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:25.596607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:25.608132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.631137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918902f7-d3e1-49c7-877e-e8d9c53df7ed None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.669241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.669845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.670122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.670391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.671186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:25.671490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.672464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 318/634] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:25.673015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.673491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.684835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.690033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 317/635] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:25.696770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.798594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7daae6-95ef-46f8-8fd0-daf59ae9d398 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.845376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.845983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.846256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.846520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.847244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:25.847539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.849003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:25.869231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 319/636] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:25.874828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:25.880160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:25.944329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b5d32-b879-4a2d-a4d8-cb7c11399ded None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:25.981356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:25.982222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:25.982657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:25.982921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:25.990249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:25.991681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6232de3f-330a-4bb8-86c5-3d3f82977465 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:26.002568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:26.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 318/637] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f6c0-e7e3-4773-bb81-cf6e7c81ad6b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.008985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f6c0-e7e3-4773-bb81-cf6e7c81ad6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.009721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f6c0-e7e3-4773-bb81-cf6e7c81ad6b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.009721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 319/638] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:26.009721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f6c0-e7e3-4773-bb81-cf6e7c81ad6b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.031171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b7274-0397-4f40-bc6f-f8f914b9f775 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.070346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.070887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.071162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.071435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.074307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.118343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f6c0-e7e3-4773-bb81-cf6e7c81ad6b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.146445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.149208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.153227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.154173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.154815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.155073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.155341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.166093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-439616ef-0045-42ee-bf61-98ba0d55ee3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:26.172071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:26.173097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 320/639] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:26.176925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.178160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.178160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.192947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:26.194115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:26.266293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 320/640] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:26.267150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.272796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 321/641] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:26.273644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.331144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.380389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48550f7-033f-48a3-956c-29dbce0489b6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.382340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.387500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e61c88-c7f4-4135-8b91-bac8c7a421d5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.422763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.423796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.424275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.424759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.425136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.425975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.426252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.426473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:26.426595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.427079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.427183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:26.427444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.428841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.429272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.442225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 322/642] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:26.442225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.456022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 321/643] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:26.457203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.543929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1212fb-195d-469c-9f89-8af6bb61b2bf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.557800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.567822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d90a-fc39-420c-afae-76169e3cb5f2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.579244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.579901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.580179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.580445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.591384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.592795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.608660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.609277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.609573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.609819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:26.610186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:26.611138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:26.612085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:26.612085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:26.612085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:26.612085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 323/644] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:26.613175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.622892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.623183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:26.640023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:26.641190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:26.642374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:26.642374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:26.642374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:26.642374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 322/645] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:26.642374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.657885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.726556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a33c1-2afe-4f3b-ba21-c80a741b6588 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.747525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec92-33c8-4424-860f-a8a1d025f3c6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.762367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.763226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.763685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.763989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.782961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.783593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.783911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.784197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.795474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:26.798984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:26.800101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:26.801031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:26.801865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 323/646] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:26.802562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.848522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.850643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.878009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:26.907532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403325f-94fd-486b-b9ae-ca2c729c45dc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:26.944454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:26.945306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:26.945585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:26.946261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:26.947174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:26.947477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:26.950123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:26.956368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 324/647] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:26.957397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:26.970636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 324/648] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:26.970636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.024172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.064263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2114-1cbb-42f1-a322-a94dbf3a9418 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.081363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216f43-9e12-49bf-8cf1-9c6ddd7a6477 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.102835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.103368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.103646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.104037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.105349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.105654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.107024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.114024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.123889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 325/649] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.123889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.125709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.126668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.126761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.126997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.127693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.128025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.129415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.143948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 325/650] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.143948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.237425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541356e-8972-4ea4-97c1-7d38eebed335 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.252540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ce67-5db2-4530-8150-0ca99d1d7e92 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.261540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.271873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.272497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.272771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.275111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.283124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.284592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.287137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.287773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.288075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.288344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.294998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.296460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:27.298635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:27.299562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:27.300470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:27.300470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:27.300470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:27.300470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 326/651] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:27.300470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:27.310959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:27.312051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 326/652] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:27.313135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.366913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.401608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e817-6298-4f9e-8044-042d7d91441c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.413584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4f406-9bc5-481d-a6ae-a8006674cacd None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.440195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.440826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.441123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.441392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.449723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.449885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.450450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.450726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.450994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.451403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.461612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b07a5e51-3cd2-499a-86b0-c55032659bd9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:27.462688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:27.464069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:02:27.465299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:27.465882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.465954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 327/653] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:27.465954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438c540-9013-4867-8f67-a0673f9338a0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.465954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438c540-9013-4867-8f67-a0673f9338a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.465954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438c540-9013-4867-8f67-a0673f9338a0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.467257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 328/654] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:27.467979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438c540-9013-4867-8f67-a0673f9338a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:27.484370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:27.485438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:27.486702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:27.486702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:27.486702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:27.486702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 327/655] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:27.486702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.508833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.573642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438c540-9013-4867-8f67-a0673f9338a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.586583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9406-f7e0-4a00-a3f6-f7e848915a4a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.593735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.607096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.607698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.608001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.608271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.608907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.609202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.610567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.620719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.621278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.621557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.621825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.622234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 329/656] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.622512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.622815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.623026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.624277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faba00-3294-4669-abda-9c70734673c7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.636731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 328/657] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.637963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.638219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.638489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.655849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:27.657032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:27.720125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bea027-39ee-4bfd-bbfe-5141f0a09c23 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.720314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 329/658] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:27.720992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.736110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.756626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.761481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.777144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 330/659] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.778297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.829523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:27.835648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebc23-8278-4e2a-a7f2-c5caecf9153e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.879089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.879786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.880074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.880682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.881626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:27.881930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.883008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587256-890a-4f97-aa3f-083482c285e6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:27.883305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.899502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 330/660] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:27.900476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.924025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:27.924652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:27.924930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:27.925204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:27.932511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:27.934164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:27.945265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:27.946207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 331/661] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:27.947118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:27.965647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.010511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77d758-acba-4691-9e73-99fa2e587b50 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.044240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.044859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.045119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.045393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.046104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.046409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.047935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.048782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede408-528b-4d45-98ca-8d6d2e6d64eb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.053687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 331/662] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:28.054304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.079188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.087018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.087637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.093845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.093845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.176175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.176626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d54d43-bac3-4d19-8b0c-ca1d8a71d8a4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.177574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.195424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.217444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.218077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.218351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.218618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.230097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.231881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:28.245635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:28.246758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:28.247947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 332/663] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:28.248625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.297889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 332/664] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:28.298577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.348353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.368772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e119-c3ce-42ed-9437-657d9873ddc4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.403992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99f25b-5fb5-4fdd-a653-be4f42f957ae None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.406209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.406896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.407175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.407445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.408161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.408460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.409889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.421293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.422691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 333/665] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:28.423405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.442476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.443117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.443501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.443795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.455377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:28.461425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:28.462365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 333/666] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:28.468293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.539683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87f2d1-75f9-43d9-abae-f64584e0916e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.575182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948029-2823-464b-a4f7-563ca5b205ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.577298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.578294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.578294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.579939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.579939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.579939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.581002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.593903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.605089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 334/667] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:28.607498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.614322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.620270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.620270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.620270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.626305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.627781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:28.642589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:28.643600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:28.649497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:28.649497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:28.649497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:28.649497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 334/668] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:28.649497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.673515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.724029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957910f-4dc7-49d1-9ae5-21584b56290b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.757164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d115d-3e96-42d0-a439-98de7606f757 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.770641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.771255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.771533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.771822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.772548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=69f48db1a2504c9f80ceead1166e374a) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.772854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.774285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.792022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 335/669] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/role_assignments?user.id=69f48db1a2504c9f80ceead1166e374a&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:28.793355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.795593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.796262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.796540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.796811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.797505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.797806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.799793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.809929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 335/670] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:28.810810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:28.891968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.921715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:28.937528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb9ea1-08e0-4276-975f-5e5c9694c5e7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.938815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531cb36-e12c-451a-931a-7547bc5a5049 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:28.979965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.981003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.981426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.981843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.982786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:28.983002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:28.983417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:28.983612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:28.983947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:28.984211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:28.985599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:28.999199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 336/671] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:29.000089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.065266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.066839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.129419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15c474-f849-4ece-b8ff-959201d9bac5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.150658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.179407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.180700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.181331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.181805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.192309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 336/672] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:29.193240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.198940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.200679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.212215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:29.221767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:29.226174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:29.227153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:29.227153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:29.227153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:29.227153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 337/673] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:29.227153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.334971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18126a7-10b1-4caa-997a-c1bad8a56f0b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.345657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a9d83-2734-44c0-9eab-f3ad91cc1869 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.382205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.382979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.383353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.383736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.384247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.385063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.385488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.385767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.396402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.397624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.397867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.399596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:29.412002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:29.412900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:29.413782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:29.414211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:29.415030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:29.415944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:29.415944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:29.415944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:29.422754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 338/675] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:29.422754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.423112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 337/675] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:29.424181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.452202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.477779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.527707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9770-1e93-4187-8ac7-2bd48384dc9f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.535301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade906-134d-4e73-a62e-c99369a77114 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.564325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.564944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.565220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.565488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.566129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:29.566668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.568661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.576301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.577270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.577743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.578219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.579160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:29.579709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.581296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.583934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 339/676] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:29.585023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.607956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 338/677] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:29.609926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.696653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.715643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370dce-7f13-4630-8660-3b28af4ce4d9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.728758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adaa79-2b2e-42a3-b15b-7974932cbaf1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.748338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.752518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.753291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.753575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.753914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.762783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.764157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.774389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.775568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.776128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.776594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:29.776843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:29.777772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:29.778736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:29.780429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:29.780957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.782861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 339/678] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:29.783137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.783796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.802980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 340/679] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:29.804152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.908161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626da9-f6f7-4f47-84e6-c2bb7aa2aeb4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.931384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b762515-c9de-4070-bb5d-da22d6de03a5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:29.944462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.945092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.945365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.945628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.953219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.954731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:29.967114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:29.968426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:29.969350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:29.972097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 340/680] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:29.972937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:29.976842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:29.977696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:29.980077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:29.980454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:29.980663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:29.981396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:29.981699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:29.983160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.002967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 341/681] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:30.003635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.044669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:30.100668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6eab6-e930-4fe3-b0f5-5e5b1136fd7e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:30.127021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075c6c7-5488-40d2-9cff-e9ffc2345526 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:30.138730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:30.139329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.139662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.139962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.140674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=1a4fb108a9e6494f8465dc2e86911ff1) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:30.140976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:30.142404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.148035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 341/682] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:29 2022] GET /identity/v3/role_assignments?user.id=1a4fb108a9e6494f8465dc2e86911ff1&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:30.148820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.175821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:30.176881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.178144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.178657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.179890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:30.180765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:30.183377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fba1a7-a3af-47af-82e1-aba665a03b27 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.203104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 342/683] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:30.205263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158bb09-24d8-4b36-bda6-e6b4cbb2f8eb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.205760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158bb09-24d8-4b36-bda6-e6b4cbb2f8eb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.206611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158bb09-24d8-4b36-bda6-e6b4cbb2f8eb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.212886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 343/684] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:30.212886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158bb09-24d8-4b36-bda6-e6b4cbb2f8eb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.239660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:30.284098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efec5b5-04f5-4e6b-9e3c-bdcd86ce2c73 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:30.324240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:30.325300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.325798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:30.326599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.326793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.336897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158bb09-24d8-4b36-bda6-e6b4cbb2f8eb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:30.382283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:30.382886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.383416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.383416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.384164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=c637175771de4971a667a9687cfb7e3c) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:30.385268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:30.386058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100e899-828e-45dd-8694-2f17ca8e0228 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.394235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 344/685] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/role_assignments?user.id=c637175771de4971a667a9687cfb7e3c&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:30.396599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.396877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.397144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.428879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:30.430094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:30.438035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:30.439529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.549890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 345/686] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:30.580112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:30.623405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 342/687] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:30.628972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.720953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:30.738043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222b26-50d3-4d7a-8b49-df2892a2cc84 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:30.774895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:30.775548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:30.775939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:30.776112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:30.787028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:30.788526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:30.804629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:30.805630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:30.806515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:30.806515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:30.806515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:30.806515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 346/688] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:30.812064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.875805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:30.968811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf7dc-e5c5-430e-ba6b-2b3fc5c1b382 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.000949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e25cfc-47d9-4344-85e8-c8228c364644 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.025443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.026602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.026925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.027213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.028044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:31.028177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.029513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e879c-daa0-41a4-b72a-1eaceedd9a8a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.039750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.040709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.041179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.042372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.043275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 343/689] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:31.044568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347793b-420a-4563-ac09-f5db21a2d155 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.044852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347793b-420a-4563-ac09-f5db21a2d155 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.045127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347793b-420a-4563-ac09-f5db21a2d155 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.046320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 344/690] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:31.047265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.051081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347793b-420a-4563-ac09-f5db21a2d155 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.057735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e3979bf5-705e-4cb5-a53c-b368e8222964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:31.062967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:31.063985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:31.064840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:31.071851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 347/691] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:31.073393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.073874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.074406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.080383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.094630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:31.096231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:31.159366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347793b-420a-4563-ac09-f5db21a2d155 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.168129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 348/692] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:31.169238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.221350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.221994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.222273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.222544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.237033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.238524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:31.257358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:31.258284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:31.259807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 345/693] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:31.264623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.279566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7a7b1-6096-4345-8011-8b4bebbba4d8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.326279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.357676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.358302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.358577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.358843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.359514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:31.359884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.361318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.368487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.379837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 349/694] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:31.385105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814665-6640-4436-8137-fb0bc6ea2e14 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.385833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.423054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.423581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.423896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.424167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.424853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:31.425155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.426850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.439920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 346/695] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:31.452898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.567645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bf0-f820-43d5-9d26-85d8995723e8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.608779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7edb0-55dc-4063-8b6a-090a5b4c7b00 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.613552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.614400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.614879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.615325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.631060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.633379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.648286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.649147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.649629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.650080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.651538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=ab64f273e7554c40b7d7eac5f59eb3e7) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:31.651844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:31.652790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:31.653926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:31.653926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:31.653926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:31.654459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.656113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.657795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 350/696] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:31.658650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.664857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 347/697] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/role_assignments?user.id=ab64f273e7554c40b7d7eac5f59eb3e7&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:31.665880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.680663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.758769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:31.797257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9c6e-8061-4295-8ac7-887c2c1b997e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:31.840975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:31.842549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:31.843951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:31.844387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:31.845215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:31.845679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:31.847388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:31.862156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 348/698] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:31.874115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:31.980799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.014965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb326a-e558-46fb-84ad-2cab4445a7dc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.037098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590c24-e8a6-49c8-90f8-f28975f6867c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.064458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.065765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.066343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.066874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.078611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.080494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.081124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.081499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.081828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.082525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.094750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.096292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:32.100297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:32.101229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:32.102184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:32.110760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 349/699] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:32.112554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:32.119069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:32.125999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:32.126916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:32.126916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:32.126916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:32.126916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 351/700] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:32.130470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.260354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4511ad-ba93-4c7d-9921-d201df66bcf7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.262469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.274118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def3653-7ce5-43a3-a9fe-56b65596dd7d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.297453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.303962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.304810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.305092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.305363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.306092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:32.310310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.310310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4700-9fa5-462f-97e1-0fd06754bb40 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.331787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.332025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.332309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.332706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.332930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 350/701] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:32.333413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:32.333777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.334938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d04f4-b219-4cab-862c-02932c8a668d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.335258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770bec0-37a0-40d1-972f-61e2946d9bc7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.335607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d04f4-b219-4cab-862c-02932c8a668d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.336080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d04f4-b219-4cab-862c-02932c8a668d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.339064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 351/702] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:32.341473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d04f4-b219-4cab-862c-02932c8a668d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.349739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 352/703] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:32.351055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.351332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.355881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.375545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:32.376793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:32.450130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 353/704] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:32.451119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.461002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d04f4-b219-4cab-862c-02932c8a668d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.499866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.500887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.501479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.501959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.538411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.559311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504a30-0a8f-4cac-8406-7d67a5d3173d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.572225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.586383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.588264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f8ad-279f-406a-ad09-3303cc43a358 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.596979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.597699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.597973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.598239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.598868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.600344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.707804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 354/706] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:02:32 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:32.708219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 352/706] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 18:02:32.710071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.806550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a1d5-f151-49f7-b3ba-b93958e3e7e4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.807231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a1d5-f151-49f7-b3ba-b93958e3e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.807715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a1d5-f151-49f7-b3ba-b93958e3e7e4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.813684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 353/707] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:32.815472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.816010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.816507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.851932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89dcc4-23c5-46a3-9efc-4a6ee2beb8cf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:32.854459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:32.859996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:32.890094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:32.890952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:32.891137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:32.891368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:32.899255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:32.904153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:32.905792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:32.921742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:32.924542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:32.925910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:32.925910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:32.925910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:32.925910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 355/708] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:32.925910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.948458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 354/709] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:32.949751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:32.970294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.061384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293a20c-3c21-4b30-84bb-a6ec3d3fb309 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.067229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e626b-006c-4029-ba1d-1a34279ec87a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.104643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.105280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.105553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.105814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.106388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.107733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.109098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.109912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.110298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.110674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.111596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.112029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.113558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:33.119336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:33.120789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.121632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 356/710] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:33.128777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.132629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 355/711] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:33.139247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.205517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.237621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.257661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8d44-41cd-41b3-b294-00e4d3e24ca2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.266951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dbf57-9c44-4ac8-b8c2-8db7479f4315 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.297428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.298499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.298693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.299055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.299806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.300206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.301785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.311858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 357/712] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:33.311858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.316741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.316911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.317088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.317296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.325024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.326620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:33.339806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:33.340743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 356/713] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:33.342234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.445336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50705d-53b5-4fec-bbd3-547adf01e2d5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.468280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.470493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a501403-3557-4e46-8a5d-cbca80f11365 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.490256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.491218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.492157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.492658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] PATH_INFO: `/v3/services/network` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.493693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.496933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.506538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.507199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.507477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.507743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.508899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.509199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:33.509641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:33.511435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:33.512305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:33.513679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.515839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 358/714] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:33.517119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.517949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 357/715] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:33.525168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.528404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.645700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3f31-1df0-473f-a802-50fc3ce95773 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.689513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.690764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.691272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.691743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.692696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.693204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.694872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.710741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 359/716] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:33.716649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.738379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b2857-1831-4dd1-80e6-7802ca66f3f1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.782602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.805752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.806696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.807261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.807724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.808669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] RBAC: Adding query filter params (name=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.809215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.810776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.816035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 358/717] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:33.821291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:33.853008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086217-4f3d-4c27-aa01-4bfdba6889f6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:33.913770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:33.914297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:33.914574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:33.914843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:33.915570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:33.916118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:33.917607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0621a5-a8b8-43d9-ae29-f2b2351a73da None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:33.926175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:33.931257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 360/718] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:33.984226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac8ce-b6e1-4350-86d5-579ac6a93846 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:34.040740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:34.041584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:34.041964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:34.042238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:34.042879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] RBAC: Adding query filter params (type=network) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:34.043178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:34.044582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3309cf6-c1da-441e-bc3b-8c7c0faf0f0c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:34.056298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 359/719] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:34.338918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c61a-9ea3-4b37-9881-f41e27f237d2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:34.339438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c61a-9ea3-4b37-9881-f41e27f237d2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:34.339438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c61a-9ea3-4b37-9881-f41e27f237d2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:34.340801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 361/720] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:34.346896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:34.347185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:34.347466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:34.366937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:34.368152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:34.438824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 360/721] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:02:34.711744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c61a-9ea3-4b37-9881-f41e27f237d2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:34.857401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c61a-9ea3-4b37-9881-f41e27f237d2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:34.864887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:34.892876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:34.893501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:34.893773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:34.894141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:34.912630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:34.917613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:34.918553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:34.919829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 362/722] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:34.924810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:34.994026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:35.046757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33260b-f1d4-4616-9d6d-0a8c39e04f55 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:35.085373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:35.086040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.086321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.086588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.087245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:35.087541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:35.089094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165478a4-2ae9-4e2a-b978-2a2ca63d8c6a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:35.103074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 361/723] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:35.109471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:35.254166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284031-ae1b-48ca-b084-17863982ed4a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:35.289992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639849-7eac-4fc8-8533-b055bba7bb17 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.290317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639849-7eac-4fc8-8533-b055bba7bb17 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.290545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639849-7eac-4fc8-8533-b055bba7bb17 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.292847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 362/724] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:35.302148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702427c2-7747-41c5-97b4-57c804499098 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.302427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702427c2-7747-41c5-97b4-57c804499098 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.302697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702427c2-7747-41c5-97b4-57c804499098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.313890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:35.314828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.315322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.315796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.320885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-702427c2-7747-41c5-97b4-57c804499098 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:35.323563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-702427c2-7747-41c5-97b4-57c804499098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:35.335434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:35.337172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:35.367230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:35.368653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:35.369658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:35.369658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:35.369658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:35.378468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 363/725] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:35.379572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:35.413472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 363/726] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 18:02:35.424110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:35.511158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d72ce-0161-44c0-bc49-b8ee3b52a13b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:35.547507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:35.548148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.548422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.548694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.549327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:35.550893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:35.552476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:35.565571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 364/727] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:35.573811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702427c2-7747-41c5-97b4-57c804499098 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:35.645344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:35.701254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702427c2-7747-41c5-97b4-57c804499098 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:35.753860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:35.754863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:35.755340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:35.755832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:35.768858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:35.770599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:35.785158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:35.786080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:35.787053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:35.789238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 364/728] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:35.795686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:35.852568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:35.929441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:35.971108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41572-271b-4807-bd21-eaeaadac3912 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.028671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.029257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.029532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.029801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.030586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:36.030892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.032361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.056184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e1df-d470-499e-8ec7-437578ccc549 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.067486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 365/729] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:36.075444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.078143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.101405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.102533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.103009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.103489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.124620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:36.131246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:36.132259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:36.133122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:36.145782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 365/730] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:36.163317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.237991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534970e-a194-4599-bf21-432722f1d1e1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.287185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.287711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.288033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.288302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.293679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.307524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2d27-d45e-4383-b48a-6ea4cb126b56 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.350107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.351426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.352060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.352666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.353801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:36.354556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.356443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8e659-8be1-484a-a504-136b96264729 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.376125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 366/731] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:36.379219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa8e2-a221-45fb-a854-c657a2f3a92b None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.379510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa8e2-a221-45fb-a854-c657a2f3a92b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.379806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa8e2-a221-45fb-a854-c657a2f3a92b None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.380768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.381358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 367/732] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:36.382375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569c6a0-63c9-498d-b54e-e34b0a2e85a1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.382475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909581-c91a-424b-a620-9e3551064a89 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.382642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909581-c91a-424b-a620-9e3551064a89 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.382911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909581-c91a-424b-a620-9e3551064a89 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.385603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 368/733] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:36.385603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909581-c91a-424b-a620-9e3551064a89 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.424689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.493646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 366/734] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 18:02:36.493646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.493646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.493646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.503810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909581-c91a-424b-a620-9e3551064a89 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.509471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:36.510747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:36.539705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.539916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.540302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.540585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.541799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.552099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.553896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1a1ef0ef-e02e-4809-a6a3-f92e32c944be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:36.568833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:36.569825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:36.570712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:36.570712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:36.570712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:36.570712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 369/735] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:36.571304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d0cd-c015-43df-b2f0-bfa8c18191af None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.571527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d0cd-c015-43df-b2f0-bfa8c18191af None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.571814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d0cd-c015-43df-b2f0-bfa8c18191af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.580404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 367/736] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:36.581277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.613638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d9b9d0cd-c015-43df-b2f0-bfa8c18191af None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:36.614846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d9b9d0cd-c015-43df-b2f0-bfa8c18191af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 370/737] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb07-ebde-4777-991f-fc81c423bfe5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb07-ebde-4777-991f-fc81c423bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb07-ebde-4777-991f-fc81c423bfe5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 371/738] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:36.691361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cb07-ebde-4777-991f-fc81c423bfe5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.717283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e070b-224b-40b8-899c-333f9623e103 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.728138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.761874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.763112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.763482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.764094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.777184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.779435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5266b2b9-7ac2-401d-a4d2-87067af734f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:36.798918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:36.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:36.800797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:36.800797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:36.800797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:36.800797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 368/739] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:36.801436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.801716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.801990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.819934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:36.821113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:36.829680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cb07-ebde-4777-991f-fc81c423bfe5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:36.835421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:36.871886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:36.872862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:36.873438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:36.873708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:36.874346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:36.874638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:36.876017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:36.892575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 372/740] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:36.893476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.903836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 369/741] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 18:02:36.903836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:36.993918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.011690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9895079-f4fc-4063-8885-b8cd7dde8b5d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.017740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac59e-df38-4b68-afb7-168d64d03018 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.047724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.048359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.048636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.048904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.049592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.050897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.055258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.056458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.057467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.057739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.058409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:37.058711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.060091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.072190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 373/742] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:37.073058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.159319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 370/743] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:02:36 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:37.160525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.177265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915aa67-26c1-4bb8-b7fa-1ee3e775809a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.178544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.228347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.235444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.236075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.236351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.236616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.246435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.248055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:37.261033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:37.262061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 374/744] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:37.268674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.288603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96579-6b58-4e21-b6d4-be041d86023e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.327468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.328050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.328325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.328588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.342726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:37.347959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:37.348857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:37.349694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 371/745] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:37.350388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.384375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7d72-d168-40a0-975e-1c3354f563d5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.421456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.422193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.423092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.423373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.423643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.432314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.434470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:37.447065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:37.448884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:37.450255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:37.453608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 375/746] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:37.454211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.460460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949db74-0954-417b-a48a-b7c02e41f161 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.497087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.497695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.497969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.498240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.498877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.500278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.511558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.560687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3e9ee-bd2f-4205-9390-ac21cdc41d32 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.583896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 372/747] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:02:37 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:37.584660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.609831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.611067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.611553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.612059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.613028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:37.613582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.615469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.641460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 376/748] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:37.641460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.733901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5334ad0-5c40-4577-b4d9-d9da3c098540 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.766447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.779573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5bfdb-e9d1-4802-8d7f-f631f967a4e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.781821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.782539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.782913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.783300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.785425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:37.785425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.785986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.787181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:37.797816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 373/749] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:37.799581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.827738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.829039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.829467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.830129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:37.831120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:37.831884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:37.833738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:37.847936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 377/750] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:37.848799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:37.928002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5824-63e6-4a60-b765-c4f09ce5bd83 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.972179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ddfa9-f386-4932-a11b-0e0e92fc0ad3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:37.979012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:37.980633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:37.981125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:37.981551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.008711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.009423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.010366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.010722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.022047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.023591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:38.038094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:38.039277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:38.040396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:38.040396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:38.040396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:38.046201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 378/751] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:38.047163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.063862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.068943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.079437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.081258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.176690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bca1-de87-4b0b-8c6b-4a8821b67592 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.195948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 374/752] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:02:38.197101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.217618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.218832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.219551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.223579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.224549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=ab64f273e7554c40b7d7eac5f59eb3e7) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:38.225040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.226757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.238151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 379/753] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/role_assignments?user.id=ab64f273e7554c40b7d7eac5f59eb3e7&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:38.239919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.394050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.405887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b53c-a80a-44e3-ad2f-3c9ea2604d19 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.411330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.444959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f671-05fd-4ddb-a5ec-e2ee4f8648c0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.450805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.451418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.451689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.451982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.452620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:38.452912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.454371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.475722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 375/754] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:38.488747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.502225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.502855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.503132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.503403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.515264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.517042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:38.540718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:38.541786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:38.542682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:38.542682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:38.542682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:38.548536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 380/755] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:38.553395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.648188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1fd7b-db0b-4a2b-badc-37081ab6a97e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.689568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.690211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.690710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.690981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.705688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.707069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:38.731203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:38.732256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:38.733192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:38.733794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 376/756] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:38.742236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.762405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.778793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a0c8-73c2-4036-87b8-d35ca272a50d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.857042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9297-fa08-480a-bf04-c0d25890448a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:38.869037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.869938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.870344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.870702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.871353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:38.871650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.873073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.874742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:38.892740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 381/757] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:38.897725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:38.905093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:38.905715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:38.906069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:38.906337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:38.908635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:38.908940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:38.910381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:38.942959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 377/758] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:38.948734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.056111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31700e7-5276-44c5-be68-fc9c296d839a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.092316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:39.096321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.097151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.097429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.097695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.106611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.108152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:39.120628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:39.121535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:39.122512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 382/759] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:39.130519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.159886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64645691-8886-418c-915c-2e87dcfc7c7c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.223560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.223560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.223560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.223560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.233033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:39.239608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.241835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:39.269452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:39.270437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:39.271323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:39.271323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:39.271323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:39.275214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 378/760] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:39.276844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.313679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e8a6-f82f-497d-a1fd-d8238200c219 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.373362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.373962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.374235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.374498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.375180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:39.375476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.376932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8df7d6-7ecc-4185-8cab-650b2ffc41d2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.401471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 383/761] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:39.403610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da1b9-3cf4-4649-8e58-26f579cad8c5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.403918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da1b9-3cf4-4649-8e58-26f579cad8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.404197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da1b9-3cf4-4649-8e58-26f579cad8c5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.410201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 384/762] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:39.411027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da1b9-3cf4-4649-8e58-26f579cad8c5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.444610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc49b3-01fb-43e6-8377-ea69bafa4f03 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.470948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:39.486885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.487784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.488220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.488605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.489312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:39.489710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.492233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef85ac-425f-4fb1-afbd-287a425f58a0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.510568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 379/763] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:39.512238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b773c-5755-4282-aeb0-777ccabcf3df None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.512623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b773c-5755-4282-aeb0-777ccabcf3df None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.512988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b773c-5755-4282-aeb0-777ccabcf3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.532798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2b0b773c-5755-4282-aeb0-777ccabcf3df None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:39.534266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2b0b773c-5755-4282-aeb0-777ccabcf3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:39.550513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da1b9-3cf4-4649-8e58-26f579cad8c5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.575397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:39.600426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.601029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.601302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.601566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.602541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=18ea29f7742647d1b83dc7d5c6b6e054) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:39.602839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.605506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.616099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 385/764] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/role_assignments?user.id=18ea29f7742647d1b83dc7d5c6b6e054&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:39.617035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 380/765] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:39.617548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.711119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6187c-246b-47c4-8bc9-6a5b2890b2e1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.716200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6187c-246b-47c4-8bc9-6a5b2890b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.716479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6187c-246b-47c4-8bc9-6a5b2890b2e1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.717917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 381/766] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:39.723450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.723728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.724033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.761861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df65028-bcf0-4699-a3df-cb48bd2fafed None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.763490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:39.764757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:39.802467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.803477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:39.803978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:39.804448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:39.812708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:39.814517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:39.828114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:39.829024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:39.829930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:39.836720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 386/767] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:39.837913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.880452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:39.935053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 382/768] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:39.947019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d119ca-f959-4765-b9d4-b56c22f16a6d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:39.959676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:39.999081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:39.999719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.000021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.000291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.000994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:40.001294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.002734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.016128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 387/769] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:40.021982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.049686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:40.138896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0272-1bb1-49a5-b057-5497a1309a33 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.193629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:40.198833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53747780-7962-4162-a2bf-a43f096838ba None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.212480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.213725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.214010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.214281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.214864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.216277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:40.234769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:40.235876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:40.237231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 383/770] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 18:02:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:40.245353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.253009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.254173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.256164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.256449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.258527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=f66707e00ece419d9cc33f09ba016e6f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.260773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.340139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 388/771] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:40 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:02:40.342032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.393162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29e86b-4d2e-4c85-bde5-371764b8035d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.398264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:40.457500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.459011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.459776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.460289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.461409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:40.462341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.464330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3117383-2cf5-4ee0-b9f8-8738055b92f0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.472247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 384/772] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:40.474399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509cd-fdde-4e5c-8e8b-b5257d7039cf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.474853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509cd-fdde-4e5c-8e8b-b5257d7039cf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.475290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05509cd-fdde-4e5c-8e8b-b5257d7039cf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.477783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 385/773] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:40.479647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05509cd-fdde-4e5c-8e8b-b5257d7039cf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.490842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682417-cd73-4725-8d2e-88165aa10d7e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.548472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.549645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.549929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.550203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] PATH_INFO: `/v3/services/network` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.550792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.552489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1ed22242-a8bf-4085-a1e1-98041ab08e9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:40.568069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:40.569109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:40.569967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 389/774] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:40.570823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.570893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.571503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.595590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:40.597222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:40.616387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:40.622241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05509cd-fdde-4e5c-8e8b-b5257d7039cf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.672118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.672658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.672989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.673254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.673888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:40.674186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.675556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.687326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 386/775] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:40.690449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.717901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 390/776] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:40.719792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.753858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:40.878851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd6bfd-f35a-4002-af58-89a8a42764d8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.903687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909cf97-29fc-4193-9505-efbfed21c232 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:40.949227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.950030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.950401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.950762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.951485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] RBAC: Adding query filter params (name=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:40.951906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.953366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:40.963790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 387/777] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:40.970549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:40.992565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:40.993243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:40.993519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:40.993781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:40.995025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] RBAC: Adding query filter params (interface=public, service_id=a0f6d3733abd412aa0a3e8cef71a41e9, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:40.995324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:40.996729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.025970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 391/778] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/endpoints?service_id=a0f6d3733abd412aa0a3e8cef71a41e9&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:41.030880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.101814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:41.176770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:41.185142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b402cb-b5ef-4bdc-bb68-b936c26ff35c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.242376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.243159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.243577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.243719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84979e9f-0ab3-4a1e-bf27-bd772a048846 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.244480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.245440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] RBAC: Adding query filter params (type=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:41.245995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.247506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.253439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 388/779] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:41.254639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.279445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.279779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.280011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.280283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.280937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.282301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.291863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 392/780] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:41.292801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.371502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c01956-65de-447d-b414-ff06fe061f14 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.417001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.418045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.418625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.420222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.444258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:41.453905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:41.454929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:41.455847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:41.464530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 389/781] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:41.472693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.485170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:41.510445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:41.513733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2308f82-2d6c-4378-a6b4-b34696aae399 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.554276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.555144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.555504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.555788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.556672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] RBAC: Adding query filter params (interface=public, service_id=be1b4266e49b46a196fefb6a2632b507, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:41.562613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.562613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.565010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 393/782] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/endpoints?service_id=be1b4266e49b46a196fefb6a2632b507&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:41.572219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.620380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711ab8-3765-4e7c-8c6e-2b66ace108a7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.666696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.667302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.667569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.667868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.668533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:41.668827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.671156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.683128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 390/783] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:41.688794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.701626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1ec6b-e8cc-45d4-96b9-e32c97af1357 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.741896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.742504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.742777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.743043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.743931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.745869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.752371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 394/784] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:41.808375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:41.828243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c32cc-8aab-4e8b-bee7-8f9e76e0a4a8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:41.872226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:41.873130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:41.873576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:41.874026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:41.892224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:41.893948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-87e9a2d0-2efe-4eed-bbdc-8c863697d59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:41.920577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:41.921777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:41.922853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:41.922853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:41.922853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:41.924730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 391/785] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:41.930420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:41.946469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:42.050983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8235-be2c-4f8c-983a-38df8f2063bf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:42.079091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ddf8-3c4c-4688-a213-a5d4ee6f7ffc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.079295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ddf8-3c4c-4688-a213-a5d4ee6f7ffc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.079543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5ddf8-3c4c-4688-a213-a5d4ee6f7ffc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.082201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 392/786] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:42.087333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.087616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.088156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.089224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:42.089931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.090304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.090666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.091496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:42.092041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:42.093701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:42.108880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 395/787] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:42.117888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:42.118430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:42.119816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:42.247792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 393/788] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:42.362534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:42.409243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f488-2af3-456c-8577-f1de72ff21a3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:42.458210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:42.458845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.459121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.459387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.476868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:42.479020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1b3ea371-b37b-40e0-819b-83b567b6c2e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:42.498677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:42.499649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:42.500624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:42.502616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 396/789] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:42.507679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:42.596239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:42.646158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd079239-19cd-4435-ac0e-46f2f4271198 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:42.673446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a078d-71ba-41cc-9b8f-8e37c6d23df0 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.673758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a078d-71ba-41cc-9b8f-8e37c6d23df0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.673987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a078d-71ba-41cc-9b8f-8e37c6d23df0 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.675536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 397/790] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:42.680771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.681048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.681319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.693856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:42.694468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.694740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.695005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.695722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:42.696048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:42.698272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:42.710597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:42.712152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:42.717114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 394/791] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:42.718928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:42.799317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 398/792] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:42.800966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:42.850516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69dc2-1925-46a8-9fce-16decfff28fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:42.886379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:42.898467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:42.921656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:42.922337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:42.922609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:42.923017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:42.948538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:42.960322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:42.961325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:42.962165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:42.963044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 395/793] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:42.967491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26754-8b3c-4802-9e7a-b38f2753d28c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:42.974068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.041333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.042353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.042833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.043293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.064270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.066049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:43.094446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.095450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:43.096368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:43.096368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.096368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:43.098653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 399/794] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.104064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.132308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1df4e-e5b0-417a-a7a0-0eb566f7431d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.169011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.169637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.169919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.170187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.170938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:43.171247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.172650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.186525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 396/795] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:43.187554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.224880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067d5a-36ef-42c3-adde-17d12347ef43 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.239183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.255234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.268095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.270811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.270811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.270811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.270811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:43.270811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.271708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.284537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 400/796] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:43.285083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.321454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36476eab-0615-49a9-900f-c70c3700964d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.359736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.360746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.361232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.361714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.372559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:43.378938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.379894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:43.380724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:43.383232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 397/797] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.384307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.398832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47909f2a-67a5-42e1-838b-7b8f02bb6750 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.436365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.436912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.437187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.437451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.449146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.450604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:43.465564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.466545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:43.467432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:43.467432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.467432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:43.471383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 401/798] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.472383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.496278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146415-8bfe-454d-9226-94b318c4ba53 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.499072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.499786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.533612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.534234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.534679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.535042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.543804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.545354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:43.557102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.558161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 398/799] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.559165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.585362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951d374-932e-4ab9-b453-4244943022ee None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.623506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.624381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.624800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.625234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.626114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:43.626569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.628242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.642402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 402/800] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:43.643660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.672108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37005714-f7c3-4630-9acf-323777e4cb39 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.709196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.709967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.710335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.710695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.711427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:43.711862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.714186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.733311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 399/801] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:43.733311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.739785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.756903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d5ad1-20d0-47d0-ab75-3e3963ab32f5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.757132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:43.794503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.795108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.795384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.795658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.796477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:43.796778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.798274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.810140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 403/802] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:43.810967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.841233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db512c-d89a-4d8a-9f33-f02bcb4f7ec1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.878521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.879403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.879680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.879967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.890448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.892035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9a5a3cdb-3d8e-4a05-92e7-46a2087b9fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:43.907851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.908826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:43.909722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:43.909722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:43.909722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:43.909722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 400/803] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.910232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273967-8280-4885-a571-ae084a3b0d97 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.910379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273967-8280-4885-a571-ae084a3b0d97 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.910651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273967-8280-4885-a571-ae084a3b0d97 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.916489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 401/804] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:43.917625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273967-8280-4885-a571-ae084a3b0d97 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:43.928456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457988b6-d6ff-4a21-9392-c9126da98f34 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:43.964626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:43.965480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:43.966074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:43.966347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:43.976270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:43.978460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:43.995356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:43.996604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:43.997521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 404/805] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:43.998101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.004341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.012481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.032193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273967-8280-4885-a571-ae084a3b0d97 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.069360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.070057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.070332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.070596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/ab64f273e7554c40b7d7eac5f59eb3e7/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.072542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=ab64f273e7554c40b7d7eac5f59eb3e7, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.073960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95603c08-fcbf-4844-a6a8-81a4ced06c4b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.112576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404651-5099-49fc-8cd8-ea609d0aa530 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.145766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.146590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.146871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.147144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.147823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:44.148125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.149500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.151688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 402/806] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:43 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/ab64f273e7554c40b7d7eac5f59eb3e7/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:44.152947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14550f-dd8f-4c52-9280-27628f757e92 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.153222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14550f-dd8f-4c52-9280-27628f757e92 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.153489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14550f-dd8f-4c52-9280-27628f757e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.163120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 405/807] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:44.164042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.178301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3a14550f-dd8f-4c52-9280-27628f757e92 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:44.179634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3a14550f-dd8f-4c52-9280-27628f757e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 403/808] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b02c-d1ed-4eb7-abcc-fbaa5f92959e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b02c-d1ed-4eb7-abcc-fbaa5f92959e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5b02c-d1ed-4eb7-abcc-fbaa5f92959e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 404/809] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:44.260379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b02c-d1ed-4eb7-abcc-fbaa5f92959e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.271558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.327867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0b9e-ced5-4cb8-bc3c-f02474ecc7b3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.364323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.371470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.372113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.372384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.372648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.373382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:44.373771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.375200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e6a4-af30-48ab-9dac-e256c2904ef5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.398959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 406/810] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:44.401428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.401732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.401973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.404197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5b02c-d1ed-4eb7-abcc-fbaa5f92959e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.423178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:44.424894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:44.445837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.446471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.446798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.447124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.455002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.456519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:44.470489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:44.471506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:02:44.472480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:44.473004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 405/811] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:44.473542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.508700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 407/812] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:44.509479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.593540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.622070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a87cf-4391-4bf8-992a-468189b49d58 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.649666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8ec0d-1717-410c-b04e-03ed9561017e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.658847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.669933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.676294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.676294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.676294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.685914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.688074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.698259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.699793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.700376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.701400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.702305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:44.702754 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.704364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:44.707256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:44.708305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:44.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:44.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:44.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:44.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 406/813] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:44.710917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.730788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 408/814] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:44.732419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.836176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931164e-7a38-4e53-88b4-b9b11bdc58ac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.852168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83053e-6123-496f-8bf0-be29ebf45497 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:44.865081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.872478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.876426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.876426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.876426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.876426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.876426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:44.884355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:44.885425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:44.886252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 407/815] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:44.887035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.895452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:44.896367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:44.896648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:44.896913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:44.897552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:44.897847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:44.899209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:44.914994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 409/816] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:44.914994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:44.938630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:44.998780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559a10-b897-4154-a5ec-2493fd800d83 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.016192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51185c-6c77-407a-bbdf-d9d56e496b31 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.034338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.035142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.035576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.036028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.054392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.055009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.055278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.055542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] PATH_INFO: `/v3/services/network` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.056175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.058109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:45.066808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:45.067829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:45.068673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 410/817] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:45.069485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.111894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.115744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.117315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.162702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.180025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14080d00-86e3-42f0-a6ac-b5f59e4b472a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.217693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.218435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.218715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.218981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.219611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.219939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.221313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.226010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 411/818] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.226804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.232797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 408/819] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:02:45.232968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.344300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31c684-98af-47b9-b2aa-ec48fc7a6657 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.346405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.350214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84ea1-5d73-4896-be0c-362b800565c2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.381012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.381552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.381830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.382103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.382728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] RBAC: Adding query filter params (name=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.383026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.384420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.386221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.386840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.387115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.387383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.394067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 409/820] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.394067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.399002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.401522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.401635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:45.413434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:45.418686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 412/821] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:45.419593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.504749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec6b3-5ea6-48a9-b176-9ff3a019e156 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.527714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fdf71-a671-4daa-b0d6-f479f4a1acd7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.538682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.539577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.540122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.540491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.541794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.542206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.543591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.548668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 410/822] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.553837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.565764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.566388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.566665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.566934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.578429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.579930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:45.596008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:45.597001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:45.602703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:45.602703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:45.602703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:45.602703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 413/823] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:45.602703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.616105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.635849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.667365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3604-f960-4a6c-8adb-ed23a22982e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.707532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.708169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.708298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d06a82-41f4-42a8-8240-45c1f18aaf7a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.708471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.708706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.709329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] RBAC: Adding query filter params (type=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.709625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.711316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.716561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 411/824] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.717296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.748585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.749187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.749459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.749719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.750396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.750702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.752134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.769957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 414/825] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.769957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.832904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74fdd9-08f3-4e89-a05f-ac6df4d2599d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.845502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.869250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.869858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.870131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.870391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.871060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.872427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.875619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17c0ef-1f9f-4570-9cf7-fab78b81609f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:45.877681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:45.912540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:45.913109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:45.913390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:45.913657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:45.914290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:45.914586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:45.915997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:45.926905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 415/826] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:45.927670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:45.988861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 412/827] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:02:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:45.995048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:46.048829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ee66a-daa6-44e5-b184-5c4c2f438b2e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.091337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:46.107124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.107739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.108292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.108560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.109667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:46.111615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:46.115555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d278-94ca-4e2f-bec1-59fba64ddeca None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.154258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.154925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.155233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.155498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/18ea29f7742647d1b83dc7d5c6b6e054/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.174713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=18ea29f7742647d1b83dc7d5c6b6e054, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:46.174713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6edc4-fc81-4ec9-ac61-7c7594009f62 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:46.197943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 416/828] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:02:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:46.198863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:46.256441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 413/829] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:02:45 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/18ea29f7742647d1b83dc7d5c6b6e054/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:02:46.259127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f87fd-58ad-4e2e-8b0c-6da1c8cf92a4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.260755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f87fd-58ad-4e2e-8b0c-6da1c8cf92a4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.261254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f87fd-58ad-4e2e-8b0c-6da1c8cf92a4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.263899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 414/830] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:46.272644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.273656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.274129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.299018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:46.300636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:46.340462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388954-94ab-4bb9-b3ea-b4bc699a0589 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.349177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:46.382352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.382973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.383318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.383586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.393103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:46.394593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:46.396405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 415/831] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:46.410591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:46.411989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:46.412858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:46.415043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 417/832] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:46.421898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:46.534562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ab4bf-d577-446c-b10f-e76c85703dd0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.574594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.575205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.575484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.575749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.576460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:46.576754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:46.578186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:46.595559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 416/833] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:46.596947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:46.640146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:46.702574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:46.704682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb875d-3c2a-4802-aef1-18d375b8f046 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.750075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:46.754563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.755162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.755436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.755698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.756461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:46.756760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:46.758195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:46.771867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 418/834] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:46 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:46.841711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c137-3802-446b-9288-b10f4029ef67 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:46.881614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:46.882269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:46.882606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:46.882880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:46.895144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:46.900567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:46.901958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:46.902800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 417/835] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:46.910099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.020012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223c1b-4262-44df-8b0a-19977b93d503 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.021543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:47.056098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.057303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.057582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.057849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.058509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:47.058804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.060199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.069345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 419/836] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:47.076846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.175562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:47.185974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee4377-d6ae-4198-97fb-ad809249fb6b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.224204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.224841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.225121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.225386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.236599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.238066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:47.253952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:47.254960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:47.256354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:47.256354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:47.256354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:47.256354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 418/837] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:47.261911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.367070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877a8e5-87e0-445c-a7d7-91fd87cb6a9c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.406317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.406928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.407203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.407473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.408147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:47.408615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.409982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.422937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 420/838] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:47.428612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.533452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507b61a-c564-42f0-b3eb-156abcef21a4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.569026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.569691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.569970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.570237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.578456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.579939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:47.591970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:47.594409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:47.595428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 419/839] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:02:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:47.598689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.627887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:47.706525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918402ae-1f14-472e-bc21-a68e575b9275 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.743279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.743941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.744219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.744486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.745268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:47.745572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.747000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.766216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 421/840] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 18:02:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:47.771880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:47.774753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:47.880975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d3d3-829f-4af1-b5b6-7ed38ede4f3d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:47.916536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:47.917145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:47.917417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:47.917698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:47.988412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:47.989786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ba07f-544a-4493-a828-b472c49abb95 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:47.992483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.102890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 420/841] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:02:48.108587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.190549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee696-8d42-4bba-b862-4ffd8c0c3405 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.190922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee696-8d42-4bba-b862-4ffd8c0c3405 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.191122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee696-8d42-4bba-b862-4ffd8c0c3405 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.192745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 421/842] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:48.194300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.198260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a7a9-aeb1-42b5-9f1c-06b7cf086221 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.198541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a7a9-aeb1-42b5-9f1c-06b7cf086221 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.198813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176a7a9-aeb1-42b5-9f1c-06b7cf086221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.214530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff90a71-0e5a-46ec-ba3e-17d10618ca27 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.217566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a176a7a9-aeb1-42b5-9f1c-06b7cf086221 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:48.218747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a176a7a9-aeb1-42b5-9f1c-06b7cf086221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:48.253626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.254184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.254460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.254726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.266126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.268125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:48.284609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:48.285596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:48.287083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:48.287083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:48.287083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:48.287083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 422/843] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:48.292463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.318474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 422/844] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:48.402606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ae3a-10e9-45d4-8a50-a85b6565a3c2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.402930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ae3a-10e9-45d4-8a50-a85b6565a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.403153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ae3a-10e9-45d4-8a50-a85b6565a3c2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.405112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 423/845] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:48.411053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.411330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.411744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.420260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920afe0e-99cf-41c9-92c0-1cee55af459f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.438512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:48.439999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:48.462249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.465024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.465545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.466011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.466848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:48.467355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.469059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.470925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.475644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.484046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 423/846] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:48.489374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.527138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 424/847] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:48.597622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.611460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bb2f7-a1d3-494c-815e-b3cb956cc206 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.652393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.653022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.653296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.653563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.665536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.667702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:48.679117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:48.680054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:48.681003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 424/848] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:48.686696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.728737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077c1e3-162e-49d6-9971-346a7c371e8b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.750448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.769549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.770178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.770502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.770910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.771410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.772825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:48.782259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:48.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:48.789546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 425/849] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:48.790384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.815017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bea4a0-0f11-4859-bd09-d51d74ce793b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.831512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:48.851376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.852004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.852278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.852547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.853297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:48.853779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.855690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.873445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 425/850] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:48.873445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.912907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df3124-04c4-4e42-9ecd-1de5f9a47056 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.947560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:48.948258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:48.948532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:48.948799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:48.949423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:48.949720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:48.951080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:48.955666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 426/851] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:48.956464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:48.972483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d8ef4-ac85-492a-bb15-1f0145a97686 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:48.987287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.008044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.008669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.008945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.009215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.020795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-c105b8b7-daf6-4f33-bd0b-f00e9ddd165a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:49.026245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:49.027412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:49.028286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 426/852] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:49.028973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddb1c-8899-4168-abe4-de92f1040df7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.029275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddb1c-8899-4168-abe4-de92f1040df7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.029429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddb1c-8899-4168-abe4-de92f1040df7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.035401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 427/853] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:49.035401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddb1c-8899-4168-abe4-de92f1040df7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.045940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.054945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81041679-02a1-4878-9dc8-84cdb742ad9b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.090242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.090836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.091106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.091368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.092134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=ab64f273e7554c40b7d7eac5f59eb3e7) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:49.092612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.093905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eadcc-72ef-4ebd-845e-877765028793 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.099542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 427/854] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:48 2022] GET /identity/v3/role_assignments?user.id=ab64f273e7554c40b7d7eac5f59eb3e7&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:49.100697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.100974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.101243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.125028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:49.126251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:49.149015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddb1c-8899-4168-abe4-de92f1040df7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.192444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.193060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.193333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.193604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.194241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:49.194540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.196021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.201935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 428/855] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:49.202457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 428/856] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:49.203274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.270800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.341989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51c754-937d-4cb4-a338-b9e607c0faf6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.379412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.380056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.380331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.380599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.381263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:49.381558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.382916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.392547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 429/857] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:49.398448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.480735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.489476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.508931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c63883-4c2d-4b30-9bd4-3c7535ca20ec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.547509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.548600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.549064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.549520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.561591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.569538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:49.579493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:49.580484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:49.581393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:49.581393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:49.581393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:49.583575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 429/858] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:49.588918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.612586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.615452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbfb8e-e48f-401f-8626-2c46b9c6d08d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.654912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.655925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.656392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.656968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.657894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.659478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:49.669369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:49.670332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:49.671216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:49.678619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 430/859] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:49.679909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.720869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c388ce-90de-40f4-a0e0-99b88187cb96 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.765316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.766292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.766776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.767245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.768147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:49.768680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.770333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.773105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.785521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 430/860] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:49.790693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.796328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241813a-82e7-430e-96f1-1b5fcb815fcc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.836012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.836980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.837406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.838343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.839334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:49.839803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.841454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.851291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 431/861] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:49.852465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:49.884344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:49.897314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015748-1230-4567-b0d5-9f1017af4b02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.944881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:49.945784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:49.946154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:49.946517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:49.954606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:49.956321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:49.970017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:49.971245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:49.972466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:49.975651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de75a74-49dd-4187-9e48-7be5062ab61c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:49.978994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 431/862] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:49.980248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:50.021777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:50.022638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:50.023063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:50.023502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:50.024890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:50.025513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:50.027510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:50.040167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 432/863] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:50.051458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:50.108183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5d76-13a9-4691-a842-d0c7a9ba8bc2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:50.152488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:50.153528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:50.154012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:50.154508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:50.155522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:50.156056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:50.157741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:50.179920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 432/864] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:02:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:50.187823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:50.296100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:50.305215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e32214-ccf9-4238-8068-24fc45fb05d9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:50.341420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:50.342034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:50.342311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:50.342580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:50.418953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:50.420407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:50.515406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:50.525906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 433/865] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:02:50.532870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:50.644164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d8659-d905-4081-a00a-907d6462dc52 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:50.659809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:50.681769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:50.682322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:50.682598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:50.682872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:50.692996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:50.694445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:50.709176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:50.710176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:50.711667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:50.711667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:50.711667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:50.711667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 433/866] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:50.716610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:50.823828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a472a-5746-4e5a-ac79-b01b2cac93f3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:50.859434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:50.860080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:50.860355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:50.860624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:50.861267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:50.861563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:50.862932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:50.875050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 434/867] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:50.880839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:50.982245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766f7b0-c76d-406c-97ea-d8a689c2cc3d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.016046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.016906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.017344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.017752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.024535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.027046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3a4ca586-b8e2-4c22-b198-1d1ab375aa0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:51.038978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:51.040103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:51.041360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:51.043297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 434/868] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:51.049065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.107822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:51.138983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2caf4-3bb4-480f-85b8-b26f44d459bf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.139271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2caf4-3bb4-480f-85b8-b26f44d459bf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.139567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2caf4-3bb4-480f-85b8-b26f44d459bf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.141307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 435/869] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:51.147581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6fff-472d-4202-a025-fe922ef92c6b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.147898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6fff-472d-4202-a025-fe922ef92c6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.148169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6fff-472d-4202-a025-fe922ef92c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.159504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8c0c3-53ea-4cf8-b326-7d9af40aeefc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.171272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1b3a6fff-472d-4202-a025-fe922ef92c6b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:51.172882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1b3a6fff-472d-4202-a025-fe922ef92c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:51.199211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.199871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.200003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:51.200159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.200434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.201768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:51.202144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.204029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.222449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 435/870] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:51.228719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.273286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 436/871] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:51.303923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dba2-79a5-4001-be36-6c4ab26c68f0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.304525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dba2-79a5-4001-be36-6c4ab26c68f0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.305001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dba2-79a5-4001-be36-6c4ab26c68f0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.307784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 437/872] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:51.313060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.313340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.313711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.333894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:51.335392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:51.366574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd24b9-f069-45c7-9626-3505107ed1b3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.381868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:51.404750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.405329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.405606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.405873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.406586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=18ea29f7742647d1b83dc7d5c6b6e054) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:51.406910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.408413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.420352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 436/873] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:51 2022] GET /identity/v3/role_assignments?user.id=18ea29f7742647d1b83dc7d5c6b6e054&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:51.426220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 438/874] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:51.546753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.667051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78c29-3861-47cf-a933-b589b788ca07 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.704138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.704780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.705061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.705344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.705917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.707290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.716305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:51.717188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:51.718188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:51.719044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 437/875] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:51.725766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.784129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:51.817909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:51.835058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b812-dc3d-42b0-90c0-8fd2903179f9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.858763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdb886-51e5-4e38-b5fe-7bddf95de579 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:51.873421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.874182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.874561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.874930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.875680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.877183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fc272-a4b9-41a7-8037-625490cd2909 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.897811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:51.898464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:51.898742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:51.899109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:51.899728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:51.900131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:51.901506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:51.906716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 438/876] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:02:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:51.911969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:51.939483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 439/877] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:02:51 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:52.039900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6967c-049c-4aa3-b1e6-3ebf1b954777 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:52.042566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:52.047581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d86f4-7fb4-4000-b68c-67500f09ad05 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:52.047887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d86f4-7fb4-4000-b68c-67500f09ad05 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:52.048163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d86f4-7fb4-4000-b68c-67500f09ad05 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:52.050878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 440/878] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:52.055609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe80f9-148f-4568-94b2-10b760216c91 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:52.055749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe80f9-148f-4568-94b2-10b760216c91 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:52.055993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe80f9-148f-4568-94b2-10b760216c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:52.077587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b6fe80f9-148f-4568-94b2-10b760216c91 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:52.079139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b6fe80f9-148f-4568-94b2-10b760216c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:52.090459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:52.091159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:52.091497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:52.091893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:52.092592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:52.092958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:52.094402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:52.099970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 439/879] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:02:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:52.177590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 441/880] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:52 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:52.446389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:52.554165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0ca-255c-4c93-9e26-bb45ac473bfc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:52.591479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:52.592127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:52.592406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:52.592680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:52.593342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:52.594725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353b7c4-abdb-49ed-a929-ba76fe79e414 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:52.712304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 440/881] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:02:52 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:53.550881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7a35c-2628-4a98-9d1f-ef650e25fbc0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:53.551373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7a35c-2628-4a98-9d1f-ef650e25fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:53.551373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7a35c-2628-4a98-9d1f-ef650e25fbc0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:53.552973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 442/882] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:53.558957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01b3b-ac65-4661-a685-347ee3a972d1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:53.559466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01b3b-ac65-4661-a685-347ee3a972d1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:53.559466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01b3b-ac65-4661-a685-347ee3a972d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:53.578516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9ce01b3b-ac65-4661-a685-347ee3a972d1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:53.579789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9ce01b3b-ac65-4661-a685-347ee3a972d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:53.599640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:53.663425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 441/883] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:53.940236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7a35c-2628-4a98-9d1f-ef650e25fbc0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:53.959111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1efc-d388-4d2b-9686-a1b533185fef None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:53.959743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1efc-d388-4d2b-9686-a1b533185fef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:53.960226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1efc-d388-4d2b-9686-a1b533185fef None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:53.962016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 442/884] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:53.967331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c3f9-040b-4882-9e1d-46ba6c460a69 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:53.967903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c3f9-040b-4882-9e1d-46ba6c460a69 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:53.968238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63c3f9-040b-4882-9e1d-46ba6c460a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:53.988717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fb63c3f9-040b-4882-9e1d-46ba6c460a69 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:53.990339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fb63c3f9-040b-4882-9e1d-46ba6c460a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:54.029216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.057534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7a35c-2628-4a98-9d1f-ef650e25fbc0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.082249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 443/885] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:54.083967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd56-6393-4e77-ad02-07d535b8e37f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.084460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd56-6393-4e77-ad02-07d535b8e37f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.084943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd56-6393-4e77-ad02-07d535b8e37f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.086486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 444/886] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:54.092780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.093376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.093845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.103376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.104049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.104323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.104852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.114772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:54.116301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:54.124849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:54.129917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:54.130867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:54.131712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 443/887] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:02:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:54.139212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.203616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 445/888] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:54.271615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7dd1a-f820-4c5d-9f82-8553edd8a740 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.308798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.309739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.310243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.310709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.311596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:54.312121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.313676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.316376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.323570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 444/889] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:54.329873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.343715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.360527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.444203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcee542-159e-4895-8ae9-766534b26e4c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.472237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2520-51d2-4581-af44-19cd810f52ac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.480336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.481721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.482143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.482562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.497387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.499304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.514553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.515256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.515537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.515891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.516558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.517922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:54.521348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:54.522450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:54.523516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:54.523516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:54.523516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:54.525580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 446/890] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:54.531244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:54.534511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:54.535466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:54.536344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:54.537092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 445/891] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:54.537665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.601234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.606449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.646779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a3f5b-6856-478f-bd3a-f865ed1c9947 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.646982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67f501-e1fe-4573-a1f0-47dba71defb0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.683041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.683642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.683990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.684211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.684607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.684843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:54.685138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.685232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.685470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.685737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.686370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.686520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.687853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.699161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 446/892] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:54.700111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.752455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 447/893] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:02:54 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:02:54.753225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.813329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83f56-bfb8-487a-a104-d71e20e0b099 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.842073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.866897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.867866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.868146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.868410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.869082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:54.869376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.870778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df84075-4ed5-4245-87d5-4cc34180fcee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.876182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c89d-70cc-4136-a497-7a0f78e9b321 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:54.876388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 447/894] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:54.877698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331e83-5c53-4c11-a232-e7a254c7131e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.877973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331e83-5c53-4c11-a232-e7a254c7131e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.878238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e331e83-5c53-4c11-a232-e7a254c7131e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.879820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 448/895] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:54.885429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e331e83-5c53-4c11-a232-e7a254c7131e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:54.911437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:54.927215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:54.927215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.927215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.927215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.935735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:54.937221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5c3a8587-07ae-431b-8b9d-9223afc18ad0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:02:54.951328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:54.952451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:02:54.953580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:54.955354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 448/896] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:54.956655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:54.957073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:54.957479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:54.975300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:54.976506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:55.004070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e331e83-5c53-4c11-a232-e7a254c7131e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.042195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.042796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.043069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.043333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.044002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:55.044305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.045660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.050385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 449/897] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:55.051156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.051819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 449/898] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:55.056743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.109643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.168738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56579-d052-4e45-89bf-63e752c01d92 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.169484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73eb7-a7d6-4c33-a747-2632ec2a7d20 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.185192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.205679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.206578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.206918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.207248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.208145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:55.208513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.210003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.210128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.210971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.211428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.211997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.213582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] RBAC: Adding query filter params (interface=public, service_id=58fdec61e5a34b96bff18a6abf3d2a53, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:55.214120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.215670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.221748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 450/899] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/endpoints?service_id=58fdec61e5a34b96bff18a6abf3d2a53&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:55.234878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.246574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 450/900] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:55.249994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.348960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25935-50b9-4a45-8e64-9901a5869829 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.373043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef81484-14e0-4f43-9eb1-c95213716a60 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.375570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.386500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.387103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.387376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.387695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.388331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.389738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.408145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 451/901] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:02:55.408375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.408936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.409042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.409215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.409487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.467899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.503297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.504827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.559101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb2bfd-2d5b-4f50-a4eb-095492b04d3c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.607789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.608440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.608629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.608899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.609484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.611054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:55.621119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:55.622096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:55.624585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 452/902] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:55.628877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.647616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 451/903] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:02:55.654105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.658107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.754372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35fa0f-cca9-4248-85d2-1c0188a0f1c9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.757515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.794058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34009b0-2e2d-45ee-bf25-427d92bef892 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.795349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.797542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.798159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.798761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.799595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:55.800086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.801626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.809483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 453/904] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:55.814593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.838394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.839502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.840055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.840525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.852589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.854436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:55.871698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:55.872738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:55.873659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:55.873659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:55.873659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:55.875945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 452/905] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:55.882536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:55.932803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e1847-bedf-407a-a3c9-6440f012a635 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:55.954936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:55.972654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:55.973483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:55.973757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:55.974022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:55.974642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:55.974934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:55.976505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:55.982430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 454/906] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:55.987921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.017123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19f285-e2d9-4b91-8a65-6bb1d1542d9e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.028276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:56.058765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.059431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.059714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.060013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.060655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:56.060957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.062335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.080879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 453/907] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:56.082206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.139835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f2a5-3cb8-4b4c-9db0-3b64a1be3de7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.178181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.178810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.179140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.179411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.180182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] RBAC: Adding query filter params (interface=public, service_id=7db51984c4db481490f8a713c33bc700, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:56.180490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.181892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.191864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 455/908] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:02:55 2022] GET /identity/v3/endpoints?service_id=7db51984c4db481490f8a713c33bc700&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:02:56.193164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.206294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b11e-a317-4101-b948-e13faf8f0236 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.239317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:56.257657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.258350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.258634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.258904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.266574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.268048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:02:56.280325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:56.281260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:56.282165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 454/909] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:56.288234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.326586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:56.332803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8694-41b2-4062-b27e-6ffe4c293f77 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.379345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.380735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.381167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.381995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.383036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.385103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.394005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 456/910] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:02:56 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:02:56.420633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184d738-bc65-4ee6-b895-062487caad9e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.462972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.464089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.464589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.465096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.466514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:56.467079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.470424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c14e-86ea-42a9-8ce5-cab096f938a0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.486377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 455/911] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:56.492411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:56.612401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd236d5-e9cd-47e8-9449-bbd1ed8890b7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:56.652149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:56.653100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.653582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.654074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.654993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] RBAC: Adding query filter params (role.id=d7f7ac84722f4f0faa953c923ecd6753, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=18ea29f7742647d1b83dc7d5c6b6e054) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:56.655501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:56.657157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f830d7-6ab9-407e-a1cc-9aab143494cf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:56.663409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 457/912] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:02:56 2022] GET /identity/v3/role_assignments?user.id=18ea29f7742647d1b83dc7d5c6b6e054&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=d7f7ac84722f4f0faa953c923ecd6753 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:56.727743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801131fb-b08b-4cc0-8f04-7cdbeb366ecd None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.728517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801131fb-b08b-4cc0-8f04-7cdbeb366ecd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.728517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801131fb-b08b-4cc0-8f04-7cdbeb366ecd None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.730340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 456/913] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:56.736132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:56.736752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:56.737365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:56.765850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:56.767989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:56.793750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:56.847963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 458/914] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:57.129011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801131fb-b08b-4cc0-8f04-7cdbeb366ecd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.167432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:57.238079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801131fb-b08b-4cc0-8f04-7cdbeb366ecd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.273474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662be3-8444-45a4-be82-91647110996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.274113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662be3-8444-45a4-be82-91647110996b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.274388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662be3-8444-45a4-be82-91647110996b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.274658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662be3-8444-45a4-be82-91647110996b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.275401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662be3-8444-45a4-be82-91647110996b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.276816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662be3-8444-45a4-be82-91647110996b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5b662be3-8444-45a4-be82-91647110996b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:57.285656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:57.286837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.287683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 457/915] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:57.293631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.399434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c4087-c44d-4f2d-b607-368283e3246b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.413096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9310-3bd0-4797-ac9b-24bf48d591f5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.413378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9310-3bd0-4797-ac9b-24bf48d591f5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.413653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9310-3bd0-4797-ac9b-24bf48d591f5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.416037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 458/916] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:02:57.421204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.421563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.421904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.437082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.437696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.437977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.438300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.439013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:57.439532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.442043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.442247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:57.443603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:57.450783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 459/917] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:57.457342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.481314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:57.540871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 459/918] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:57.581228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeb58c-be3c-4087-b39a-e06b1f21b58c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.618164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.619507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.619776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.622397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.622397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:57.622397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.622397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.627973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 460/919] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:57.636909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.671841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:57.744852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89d6e-bd43-4499-b790-30760d7ec3d9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.781388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.782394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.782870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.783362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.784323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] RBAC: Adding query filter params (interface=public, service_id=7d8742fd00554228922d6c36ac270d94, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:57.784826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.786381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.795024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 460/920] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/endpoints?service_id=7d8742fd00554228922d6c36ac270d94&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:57.800879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.810746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:57.911882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:57.920345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:57.929825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af763-968c-4195-8171-7175ffb21efe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.930197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a811c-2018-416d-9989-d2a63816a232 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:57.968074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.968741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.969161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.969470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.970185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.971930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.974568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:57.975702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:57.976201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:57.976663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:57.977425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:57.979030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:57.985839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 461/921] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:57.992462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:57.994167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 18:02:57.995129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:57.998131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 461/922] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:58.004554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:58.124245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f485-bbaf-4647-9890-7b59c94ce523 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:58.171594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:58.172785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.173284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.173796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.174778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:58.175291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:58.176914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:58.183150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 462/923] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:58.189427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:58.300575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8af446-a34d-4fb5-9e26-21b1d31c8bc2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:58.336915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:58.337685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.337963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.338295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.338933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:58.339235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:58.340649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cf926-63b5-42c4-b366-456918f66ebd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:58.346485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 462/924] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 18:02:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:58.352175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:58.365700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:58.460237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02186b60-90c8-4a56-8c01-b1b00b7c8a7d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:58.499785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:58.500665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.501098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.501528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.502350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:58.503950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feffeb0-3cd0-48bf-ba02-8b798b930989 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:58.559461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629042c7-1564-461c-a005-aef6a2150183 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.559826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629042c7-1564-461c-a005-aef6a2150183 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.560041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629042c7-1564-461c-a005-aef6a2150183 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.561549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 463/925] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:58.566590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.566986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.567447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.591785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:58.591785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:58.592079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 463/926] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:02:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:58.615162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:58.669134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62490a-c8fe-4843-b412-17ebd8e6d19d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.669691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62490a-c8fe-4843-b412-17ebd8e6d19d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.669691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62490a-c8fe-4843-b412-17ebd8e6d19d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.671166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 464/927] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:02:58.676737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:58.677049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:58.677278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:58.688789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 464/928] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:02:58.698049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:02:58.699269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:02:58.767006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:58.776036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 465/929] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:02:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:02:58.965290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.064967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.070614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69e67-ce3b-46b3-8665-1baee395bded None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.110815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.111443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.111715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.112048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.112634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.114011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:59.125103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:59.126212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:02:59.127639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 465/930] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 18:02:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:59.132452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.148873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:59.192240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a64f0-0eaf-4389-aa4f-ca6f6a390874 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.227213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.228747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.229251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.229977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.241472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:02:59.246972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:59.248161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:02:59.249024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:59.249681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f916-2434-4b1c-a23c-8164adb6c00c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.251597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 466/931] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:02:59.259901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.288102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.289162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.289626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.290088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.291414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:59.291928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.293671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.299330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 466/932] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:59.307726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.320605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:59.370258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a6144-a373-4dc3-9f96-e531a4898aa2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.407909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.408610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.408975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.409384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.410090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:59.410457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.411996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.412107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:59.421679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 467/933] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:59.426936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.436145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37eec-b633-4304-8d1d-6721784cb63d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.484514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.485884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.486778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.487512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.488372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:59.489147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.491106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.503575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 467/934] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:59.505197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.555888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a0e4c-b4e0-43cd-8284-657fb4100238 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.578014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:59.599346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.600623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.601327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.601608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.614295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.616303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:02:59.637542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:02:59.638578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:02:59.639457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:02:59.639457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:02:59.639457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:02:59.641243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e540228-4594-4bca-b273-aaf0ab9d7f8f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.643618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 468/935] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:02:59.645834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.678891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.679502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.679799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.680076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.680751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.682772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.693496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:02:59.765078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd87e0-bdd9-4a04-83c1-383bf075fa6b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.794813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 468/936] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:02:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:02:59.819964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:02:59.821063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.821604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.822264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:02:59.823210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:02:59.823793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:02:59.825570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa57a6-d161-4c4f-8690-b70b611db8a4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:02:59.840651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 469/937] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:02:59.846238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:02:59.971848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacaa83-6761-411f-8c84-6bc0aff1c246 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:02:59.996479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa8f0-2380-4b9a-8d5f-cb229f97226d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:02:59.997722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa8f0-2380-4b9a-8d5f-cb229f97226d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:02:59.998201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caa8f0-2380-4b9a-8d5f-cb229f97226d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.000657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 470/938] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:02:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:00.006236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.006781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.007262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.012375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.013013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.013290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.013559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.025518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.027288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.031020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:00.032420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:00.039791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:00.041449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:03:00.042399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:00.044995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 469/939] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:02:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:00.051039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.058621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.123957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 471/940] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:00.150496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.182460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58832e11-1c90-40e6-b3f8-608fc6c52619 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.236059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.236698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.237007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.237240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.237984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:00.238284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.239735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.258767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 470/941] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:00.264398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.369074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe4707-211c-4520-9d19-da0d8aeb615f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.409081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.410065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.410546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.411052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.421918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.423617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:00.439495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:00.440483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:00.441372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:00.441372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:00.441372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:00.443433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 472/942] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:00.449177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.452650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.468900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.576524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7874ec-c254-4860-98ee-77ce7792b4f4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.581516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f236cb-2edb-4def-9425-2f666dd4bdf0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.592585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.615137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.616120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.616576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.616683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.617126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.617243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.617510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.617781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.618427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.619085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:00.619544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.620604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.621646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e74e2-25c2-477b-841c-035f920bfe46 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d0a6dbb2-ba6e-417f-a64f-489e6cd70ef0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:00.629689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:00.630867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:00.631687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 473/943] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:00.632516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b930-6944-4751-a0b1-f690c581676b None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.632516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b930-6944-4751-a0b1-f690c581676b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.632516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489b930-6944-4751-a0b1-f690c581676b None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.633890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 474/944] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:00.638532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489b930-6944-4751-a0b1-f690c581676b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.638672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 471/945] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:00.640351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.640632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.640903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.658706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:00.659980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:00.722108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.736110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 472/946] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:00.736110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.762824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489b930-6944-4751-a0b1-f690c581676b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.809114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.809739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.809969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.810235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.810889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:00.811175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.812572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.822283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 475/947] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:00.822917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.866743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521647e-4ac3-42ec-9c9e-7a8c0a9a3340 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.870435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:00.921894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.922472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.922712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.922976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.932931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.935550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.937114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14225942-a91e-4920-a758-9f6c7a3ba9e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:00.951938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:00.952940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:00.953828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:00.960407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 473/948] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:00.963162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:00.987341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:00.988489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:00.988928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:00.989589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:00.990805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:00.991530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:00.994242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:00.997578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:01.003275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 476/949] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:01.004679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:01.079396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff3a1-301b-4e91-abf9-768d2bee261a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.111081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001d33-7a98-4d54-aaf8-79868382609f None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.116884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.117482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.117758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.118035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.119283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:01.119544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.121007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.133557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 474/950] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:01.134793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:01.151687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.152338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.152613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.152884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.153519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.155003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.157613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING keystone.server.flask.common [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 18:03:01.163407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:01.203147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.sql.core [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 18:03:01.203147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 18:03:01.203147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [parameters: {'id': '3804110015744247a289b0f57740be72', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 18:03:01.203147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3804110015744247a289b0f57740be72.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3804110015744247a289b0f57740be72. Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:03:01.210445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 18:03:01.211246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application yield resource Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise self.value Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application session.commit() Aug 24 18:03:01.212379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.flush() Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application compat.raise_( Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 18:03:01.213260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 18:03:01.214161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:03:01.215987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [parameters: {'id': '3804110015744247a289b0f57740be72', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:01.218004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:01.219211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3804110015744247a289b0f57740be72. Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 477/951] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 24 18:03:01 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:01.221340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:01.257739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126417ea-bb8d-4b5e-8920-ddf66b195611 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.288233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:01.297890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.298506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.298910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.299113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.299788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.301166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.333904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a786f-a588-4f81-a0e3-6d80a99a620a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.367883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.369235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.369517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.369779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/18ea29f7742647d1b83dc7d5c6b6e054/roles/d7f7ac84722f4f0faa953c923ecd6753` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.372496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=18ea29f7742647d1b83dc7d5c6b6e054, role_id=d7f7ac84722f4f0faa953c923ecd6753)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.376890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.377029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 475/952] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:03:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:01.377029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:01.476953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 478/953] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:03:01 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/18ea29f7742647d1b83dc7d5c6b6e054/roles/d7f7ac84722f4f0faa953c923ecd6753 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:03:01.485372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:01.516891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0cda8-1f90-41ad-91d8-3a88b4f1e192 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.555678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.556454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.556792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.557062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.564791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.566278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-26da09d1-6419-45bd-bbb5-1a6fc7710a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:01.582580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:01.583592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:01.585170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 476/954] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:01.590861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:01.709938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee82d4-2d54-474f-a567-298a2f386b2e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:01.727610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:01.747085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:01.747733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.748038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.748309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.749039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:01.749338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:01.750827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e113782-84d8-45d0-a5b0-0faa341c3a77 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:01.772358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 479/955] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:01.818859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507a2e-5aa8-4999-a562-9972cd954fe7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.819160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507a2e-5aa8-4999-a562-9972cd954fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.819401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507a2e-5aa8-4999-a562-9972cd954fe7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.821140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 477/956] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:01.827209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:01.827733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:01.827733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:01.848527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:01.850105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:01.925964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 480/957] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:02.196233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507a2e-5aa8-4999-a562-9972cd954fe7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:02.316390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507a2e-5aa8-4999-a562-9972cd954fe7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:02.351678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:02.352409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:02.353236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:02.353611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:02.354188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:02.355827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:02.358551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:02.365697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:02.366849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:02.367714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 478/958] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:02.372971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:02.473313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45be737-8b73-4f35-8bf4-e3b35eb89293 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:02.484984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:02.512785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:02.513403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:02.513683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:02.513954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:02.514588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:02.514885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:02.516299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f80efc-e8fd-489c-933f-8da3b4df6808 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:02.521632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 481/959] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:02.528838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:02.636899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d38193-8086-445b-8314-6e479d7d5218 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:02.674082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:02.674683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:02.674955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:02.675217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:02.675860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:02.676160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:02.677514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b77f4-4952-46b4-94f3-586f26592f24 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:02.682389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 479/960] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:03.450082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9a-750b-4779-8a6d-b70c787a516c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.450601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9a-750b-4779-8a6d-b70c787a516c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.450601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f6e9a-750b-4779-8a6d-b70c787a516c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.452266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 482/961] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:03.457503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.457921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.458107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.476721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:03.478549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:03.501695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e173-4bfe-4320-a3fe-066bcc16f332 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.501979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e173-4bfe-4320-a3fe-066bcc16f332 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.502158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e173-4bfe-4320-a3fe-066bcc16f332 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.503732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 483/962] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:03:03.508708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebd82-4a75-42ef-808f-aa38b26dd9ab None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.509520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebd82-4a75-42ef-808f-aa38b26dd9ab None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.509795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebd82-4a75-42ef-808f-aa38b26dd9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.528811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-63eebd82-4a75-42ef-808f-aa38b26dd9ab None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:03.530034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-63eebd82-4a75-42ef-808f-aa38b26dd9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:03.550145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:03.557577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 480/963] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:03.604195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 484/964] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:03.836035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:03.844794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc66d9-03cc-40f2-9c94-bea429a2196e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.845417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc66d9-03cc-40f2-9c94-bea429a2196e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.845937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc66d9-03cc-40f2-9c94-bea429a2196e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.847480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 485/965] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:03.854208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.854487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.855013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.878046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:03.879254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:03.947623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311bd8a-7562-4ab3-88ac-fa66fb92e8b4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:03.954972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 486/966] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:03.955920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:03.986647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:03.987222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:03.987553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:03.987846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:03.988420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:03.990049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:03.990166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:04.000119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:04.001176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:04.002023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 481/967] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:03:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:04.012707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.074101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075a0e-0381-436f-bcfa-cff196f3319e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.091929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.114590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.115559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.116059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.116510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.129743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:04.135496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:04.136478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:04.137388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.139995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 487/968] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:03:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:04.145744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.147137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb533e1-22f2-446d-a37c-f0aaf13ce287 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.184752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.185717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.186176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.186628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.187432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:04.187962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.189574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.195143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 482/969] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:04.201796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.258009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.270926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021d0d7-5278-498e-9981-3374185f46fa None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.311107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.311723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.312028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.312305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.312965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:04.313266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.314641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.315461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0be1-9727-49f4-99ca-a72303e3fe29 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.323793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 488/970] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:04.324410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.345445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.357546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.358264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.358616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.358895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.359525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:04.360029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.361221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.371133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 483/971] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:04.371133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.434562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4742-f339-4095-9f8c-e5b4dd12a424 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.469278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.470143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.470433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.470704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.471483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.473301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.480682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91a545-1c70-4fba-ba64-c40a49cd16d0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.514219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.514850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.515125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.515395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.526670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.528148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.529284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.sql.core [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 18:03:04.529284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 18:03:04.529284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [parameters: {'user_id': '47576ca595844f159f0c757708d73fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 18:03:04.529284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:03:04.536536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:03:04.537429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application yield resource Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise self.value Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application session.commit() Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 18:03:04.538370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.session.flush() Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application compat.raise_( Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 18:03:04.539277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 18:03:04.540334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application result.read() Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 18:03:04.542422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [parameters: {'user_id': '47576ca595844f159f0c757708d73fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:04.543287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 18:03:04.544375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 489/972] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 18:03:04 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:04.545332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:04.551305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:04.560584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:04.561706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:04.561706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:04.561706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:04.561706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 484/973] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:04.561706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.575036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.605011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.662426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39beaf9-38b8-4b46-84ed-f4147d4808b0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.663829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a061-0aeb-4902-b108-b7f500aaa884 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.697643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.698241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.698514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.698780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.699387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.699502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] RBAC: Adding query filter params (interface=admin, service_id=7d8742fd00554228922d6c36ac270d94, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:04.699786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.700036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.700310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.700574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.701363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.707688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.709147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.709530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 490/974] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/endpoints?service_id=7d8742fd00554228922d6c36ac270d94&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:04.710328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-890ba954-8d26-4b1a-9c5e-8bcc8bb9a171 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:04.724456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:04.725584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:04.726536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 485/975] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:04.727234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5938-4475-46e9-98d5-1ccb9928a6aa None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.727234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5938-4475-46e9-98d5-1ccb9928a6aa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.727234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5938-4475-46e9-98d5-1ccb9928a6aa None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.732004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 486/976] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:04.732871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a5938-4475-46e9-98d5-1ccb9928a6aa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.791778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.813080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bd5c1-6ddb-412a-b1f9-56ea699a07ee None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.830130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:04.835045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a5938-4475-46e9-98d5-1ccb9928a6aa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.846643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.847253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.847532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.847827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.848469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:04.848771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.850130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.862891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 491/977] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:04.863626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:04.870334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:04.870940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.871211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.871474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.872094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:04.873450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8975d-6d74-4da3-b078-03cf248e06ee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:04.879558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 487/978] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:03:04.880783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:04.881059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:04.881328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:04.905517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:04.906723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:04.980161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 488/979] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:04.980616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90698ea1-d58e-4571-91e1-517b21eceedf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:04.981780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:05.026575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.027559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.027870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.028138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.028887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:05.029187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.030666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.050705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:05.072270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 492/980] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:05.098964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:05.109920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd0f3-335e-4030-a79b-4f0acdbb7490 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:05.150003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.150671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.150956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.151228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.159665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.161181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:05.175323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:05.176372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:05.177317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 489/981] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:03:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:05.182951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:05.270007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:05.316561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dca1e-04b1-450a-86c3-153f29cd61d0 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:05.359793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.360412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.360690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.360961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.361694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:05.361991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.363421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.382598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 493/982] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 18:03:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:05.388153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:05.407414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e9ba8-0d64-4266-9794-d42601afb5df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:05.444705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:05.448129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.448742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.449019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.449292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.449945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.451312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.491545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af9db9-1b20-43ae-bcc7-27b49bb04414 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:05.506856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 490/983] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:03:05 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:03:05.542623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.543248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.543524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.543823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.621368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.622867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.677563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:05.730388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 494/984] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:05 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:03:05.736101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:05.751698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:05.838204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315bd7-546f-413c-86fa-c9b58900ae7a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:05.872085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:05.872714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:05.872990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:05.873257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:05.883264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:05.885386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:05.900081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:05.901148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:05.902053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:05.902053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:05.902053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:05.903836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 491/985] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:05.907131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:06.012561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f897e8-f0dc-4059-8064-1b9a6b670c16 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:06.048278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:06.048886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.049162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.049430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.050067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:06.050363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:06.051730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:06.067458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 495/986] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:06.068672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:06.131800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:06.171035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842451f-ab50-4ddc-8b2c-a0c2c3db0cb5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:06.206249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:06.206870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.207145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.207412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.214506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:06.215991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:06.228573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:06.229692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:06.231345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:06.235785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:06.236243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 492/987] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:06.250020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:06.338771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aeafd2-bc38-48fa-849b-19415c590bcc None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:06.372272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:06.372931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.373267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.373541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.374227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:06.374531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:06.376166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec2ca-016d-43bf-8922-d729724f6385 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:06.393555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 496/988] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:06.395415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:06.497308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416823-8bbc-40e1-b5c4-2aa77123eaa1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:06.527115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:06.537934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:06.538542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.538817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.541313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.541313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] RBAC: Adding query filter params (role.id=d7f7ac84722f4f0faa953c923ecd6753, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=18ea29f7742647d1b83dc7d5c6b6e054) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:06.541313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:06.542305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3ca57-bc5f-4d62-8af1-d536d7447641 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:06.549515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 493/989] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:06 2022] GET /identity/v3/role_assignments?user.id=18ea29f7742647d1b83dc7d5c6b6e054&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=d7f7ac84722f4f0faa953c923ecd6753 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:06.871375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329df061-68ec-4552-b908-d48643351472 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.871931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329df061-68ec-4552-b908-d48643351472 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.871931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329df061-68ec-4552-b908-d48643351472 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.873411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 497/990] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:06.878490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:06.878773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:06.879042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:06.897559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:06.898725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:06.967287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 494/991] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:07.235392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329df061-68ec-4552-b908-d48643351472 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:07.306567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:07.337233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329df061-68ec-4552-b908-d48643351472 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:07.372163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:07.372785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.373055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.373320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.373887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:07.375236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-814234bd-ba9f-4f85-81fc-68418c87e9df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:07.383909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:07.384957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:07.388994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 498/992] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 18:03:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:07.391218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:07.480427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246f6e-b99b-4cdb-83f2-1935f0cd8f38 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.481019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246f6e-b99b-4cdb-83f2-1935f0cd8f38 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.481465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52246f6e-b99b-4cdb-83f2-1935f0cd8f38 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.483292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 499/993] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:03:07.488369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.488591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.488864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.491936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944bde2-5013-4f0d-9c57-027d62528c6f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:07.507264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:07.509355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:07.511112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:07.530042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:07.530688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.530917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.531172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.531821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:07.532121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:07.533486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:07.538361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 495/994] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:07.543817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:07.599065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 500/995] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:07.649269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dab1-d9da-4e52-a6be-05fb3e21c9ab None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:07.685907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:07.686511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.686782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.687050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.687665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:07.687990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:07.689353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:07.694234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 496/996] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 18:03:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:07.699742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:07.761439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:07.798974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfc53a-e9fd-4526-b5b8-b2cb6ade5aad None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:07.831890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:07.832488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:07.832760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:07.833023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:07.833678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:07.835028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:07.863071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:07.895791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 501/997] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:03:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:07.922225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:07.984392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3ee4-f08d-4317-b38f-c841c55a64c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:08.029307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:08.029497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.029708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.029903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.030455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:08.032305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:08.041763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:08.042781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:08.044008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 497/998] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:08.048929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:08.158393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fbc80-15e3-4c56-88b5-c39116d5f11e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:08.182438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:08.193390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:08.198019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:08.202778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 502/999] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:08.208711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:08.339552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be863-825d-4eef-95d8-987925c9f67f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:08.346791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:08.377043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:08.377667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.377946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.378269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.378903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:08.379230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:08.380789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32fac-bed9-4f37-9a09-4246d0c696f8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:08.388103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 498/1000] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:08.392208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:08.500782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587633-a872-4d66-95c2-840f6ab67a05 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:08.532009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59adf-6641-4916-936a-936fb56a8a45 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.532525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59adf-6641-4916-936a-936fb56a8a45 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.532525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59adf-6641-4916-936a-936fb56a8a45 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.533993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 499/1001] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:08.536984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:08.537709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.537992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.538262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.538695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.538964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] RBAC: Adding query filter params (interface=public, service_id=2ec262918c794a4ba7a7b547eab465d5, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:08.539061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.539233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.539334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:08.540741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:08.551805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 503/1002] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:03:08 2022] GET /identity/v3/endpoints?service_id=2ec262918c794a4ba7a7b547eab465d5&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:08.553049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:08.557734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:08.558982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:08.620501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:08.639415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 500/1003] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:08.672978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe97ae-ac62-4ddc-8cf2-73e17ff6a314 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:08.708064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:08.708668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:08.708948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:08.709221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:08.709822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:08.711187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:08.717470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 504/1004] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:03:08 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:03:08.913270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:09.021513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:09.025547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe847f1-a055-47e9-b6e6-99ad1f7e2dc4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:09.061584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:09.062220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:09.062496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:09.062765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] PATH_INFO: `/v3/services/image` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:09.063339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:09.064738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:09.073587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:09.074581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:09.075421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:09.079736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 501/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 18:03:08 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:09.080757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:09.181485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c12258-ee85-4583-a808-bc5468aa720a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:09.197689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:09.216952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:09.217563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:09.217840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:09.218110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:09.218736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:09.219293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:09.221160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4da35-cb98-4476-abd2-7c8b407adbe7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:09.230198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 505/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:09.236297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:09.340838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659454-6d04-4c13-852c-a49a9b5a9e46 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:09.383581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113842f8-b464-4822-8580-13078fdef57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:09.384519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113842f8-b464-4822-8580-13078fdef57f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:09.384965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113842f8-b464-4822-8580-13078fdef57f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:09.385402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113842f8-b464-4822-8580-13078fdef57f None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:09.386775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113842f8-b464-4822-8580-13078fdef57f None admin] RBAC: Adding query filter params (type=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:09.387219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113842f8-b464-4822-8580-13078fdef57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:09.388772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113842f8-b464-4822-8580-13078fdef57f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:09.393750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 502/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:09.848004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c36b-3794-474b-9574-806528dd1a7a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:09.848412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c36b-3794-474b-9574-806528dd1a7a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:09.848607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c36b-3794-474b-9574-806528dd1a7a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:09.850033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 506/1008] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:09.855610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:09.856088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:09.856187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:09.873867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:09.875024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:09.897839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:09.941103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 503/1009] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:10.207310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c36b-3794-474b-9574-806528dd1a7a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:10.328912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c36b-3794-474b-9574-806528dd1a7a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:10.363637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:10.364290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:10.364568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:10.364839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:10.365956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:10.367393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5b92-8cd4-4456-a641-4ce8bb61c909 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:10.369756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 507/1010] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:10.375485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:10.480840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827fa7d-4eee-4b02-a248-869e9309b0d7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:10.514799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:10.515453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:10.515741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:10.516035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:10.516680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:10.518103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65fd90-171f-4ce4-842f-92694b0a01a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:10.623783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 504/1011] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:03:10 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:10.699632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c182-45ef-4fed-b0e2-347f2279f1ed None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:10.699978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c182-45ef-4fed-b0e2-347f2279f1ed None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:10.700222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c182-45ef-4fed-b0e2-347f2279f1ed None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:10.701747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 508/1012] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:10.707420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:10.707709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:10.708045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:10.727502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:10.729270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:10.733915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:10.802305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 505/1013] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:11.074221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c182-45ef-4fed-b0e2-347f2279f1ed None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:11.129471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:11.182260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c182-45ef-4fed-b0e2-347f2279f1ed None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:11.217702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:11.218997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.219418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.219855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] PATH_INFO: `/v3/services/compute` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.220604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:11.222112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-cad32395-47c9-47ce-918c-572cd3713cba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:11.233169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:11.234451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 18:03:11.235463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:11.237935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 509/1014] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:11.243690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:11.321934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b956-45d5-4975-bb79-a0390eac8174 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.322242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b956-45d5-4975-bb79-a0390eac8174 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.322511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b956-45d5-4975-bb79-a0390eac8174 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.327899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 510/1015] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:11.329204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.329477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.329748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.347906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:11.349092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:11.350693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c61ca-6a14-48a8-95d9-f619d8d00643 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:11.386247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:11.386864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.387140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.387412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.388074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:11.388378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:11.389756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:11.394602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 506/1016] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:11.401816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:11.405887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:11.425565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 511/1017] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:11.504605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a838812-f3f2-41ba-8e02-c16b3f6d30d0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:11.537661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:11.538266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.538537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.538799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.539413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:11.539706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:11.541700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:11.551017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 507/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 18:03:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:11.552356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:11.598300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:11.657944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb513c1f-3ba0-4fea-bfb1-3d0dc84ac512 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:11.692471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:11.693074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.693346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.693609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.694254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:11.695616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b2127-9f70-476e-b4c4-7589a480512c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:11.713535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:11.776276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 512/1019] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:03:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:11.784054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:11.822653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a151e-c2e8-4543-998d-6e1c867cadfb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:11.866940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:11.867531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:11.867836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:11.868159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:11.868869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:11.870249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086e804-597d-4f6d-b647-46f42ff56dd4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:11.964394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 508/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:03:11 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:03:12.596719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425255-8385-44ba-8446-06b8ee8051ee None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:12.597237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425255-8385-44ba-8446-06b8ee8051ee None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:12.597237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425255-8385-44ba-8446-06b8ee8051ee None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:12.598665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 513/1021] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:12.604330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:12.604725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:12.605171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:12.623567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:12.624790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:12.707580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 509/1022] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:12.979359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e425255-8385-44ba-8446-06b8ee8051ee None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:13.083171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:13.088601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e425255-8385-44ba-8446-06b8ee8051ee None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:13.121771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:13.122410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.122683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.122950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.124083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:13.125632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70747-b682-4371-a5b5-0ecde63ac0ae None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:13.127388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 514/1023] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:13.132917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:13.183502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:13.240338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f0b97-f666-4269-b3d0-9896e125666e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:13.274634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:13.275244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.275516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.275805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.276456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:13.277885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7b0ed-7e1b-47e0-9e84-73baff5fc69a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:13.409475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 510/1024] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:03:13 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:13.809390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e620-2bba-4fa8-b2ec-0d2c09f3cdcf None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.809935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e620-2bba-4fa8-b2ec-0d2c09f3cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.809935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3e620-2bba-4fa8-b2ec-0d2c09f3cdcf None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.811421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 515/1025] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:13.816462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.816879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.817044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.835106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:13.836304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:13.896968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f511e-7b25-4213-acff-acb39f45fa40 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.897276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f511e-7b25-4213-acff-acb39f45fa40 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.897504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f511e-7b25-4213-acff-acb39f45fa40 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.898849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 516/1026] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:03:13.905131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:13.905484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:13.905821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:13.907801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 511/1027] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:13.924278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:13.925563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:13.995237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 517/1028] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:14.172607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.208484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.259789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.283208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d459ca0-ea12-4c68-9297-b0d2e5b78c84 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.324291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.325404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.325972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.326476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.339028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:14.343678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:14.344808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:14.345813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 512/1029] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:14.351178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.368515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.375374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ab2e-0063-4df4-9f0b-27c7f8b19955 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.411462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.412114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.412633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.412633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.413218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.414577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:14.423474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:14.424632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:14.425487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 518/1030] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:14.430248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.457216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.463718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0275-0801-493a-85e7-fcf42ccd0c61 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.502776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.503388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.503668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.503984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.504625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:14.504927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.506310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.516232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 513/1031] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:14.521672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.544911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c96f-7400-4e85-a175-297048b50ba1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.582377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.583307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.583776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.584275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.584796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:14.585096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.588217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.592120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 519/1032] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:14.598044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.627013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.630981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037f50-b8b3-40aa-b45d-2aa2b3f944c0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.667449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.668117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.668400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.668672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.682851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.684279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:14.698813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:14.699787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:14.700807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:14.700807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:14.700807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:14.700807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 514/1033] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:14.705822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.717861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1c29-c296-4ecc-9d89-c31d09e7a7a5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.719610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.755135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.755747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.756047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.756362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.756998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] RBAC: Adding query filter params (type=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:14.757296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.758801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.764093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 520/1034] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:14.769998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.809644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059e4c2-5ee9-4c60-bdb8-22136eb90eee None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.845823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.846457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.846694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.846964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.847599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:14.847926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.849303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.862835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 515/1035] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:14.868304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.870285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.882104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908de6-16d5-4f21-b881-831c8439ef28 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:14.918864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:14.919464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:14.919737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:14.920046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:14.920744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] RBAC: Adding query filter params (interface=public, service_id=4670fca638e841a0a2ce3caf2b9b69a5, region_id=RegionOne) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:14.921045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:14.922458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:14.932678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 521/1036] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/endpoints?service_id=4670fca638e841a0a2ce3caf2b9b69a5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:14.933493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:14.942360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:14.973556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e9bab-1e92-4a14-b401-8e1ac2421a3a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.009715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.010355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.010631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.010901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.018559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.020047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:15.031133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:15.032194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:15.033160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 516/1037] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:15.037858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.041824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0412ad-4d62-4c2a-b15f-fc898ea51ea8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.077657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.078707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.079187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.079671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.080562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.082191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.089567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 522/1038] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:03:14 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:03:15.161664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4fd9f-650d-4dba-a3cd-3691688dcb2f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.192928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:15.200199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.200924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.207000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.207000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.207000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:15.207000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.207000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fca56d-4171-471a-990f-c431b9525dab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.228927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 517/1039] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:15.234556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.254625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:15.341897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31144c-1e18-4a69-8604-6253480b249e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.384269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.384966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.385239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.385500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.438450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb3ac-43fb-4cd2-9274-b2815caa1459 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.438786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb3ac-43fb-4cd2-9274-b2815caa1459 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.438989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb3ac-43fb-4cd2-9274-b2815caa1459 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.440468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 518/1040] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:03:15.445835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.446095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.446688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.456525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.457975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.465000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:15.466162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:15.476592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:15.536932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 519/1041] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:15.567196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 523/1042] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:15.573893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.676271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cab8c-9f0c-4764-8fab-24256b737c2e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.693514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:15.711411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.712675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.712957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.713228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.723962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.725418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:15.740807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:15.741759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:15.742657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:15.742657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:15.742657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:15.744089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 520/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:15.747832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.819287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.855486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9ff2d-edfe-498f-8f3f-4d1774d68ace None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.872614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:15.890429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.891032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.891303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.891564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.892225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:15.892518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:15.893917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:15.907209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 524/1044] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:15.912523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:15.932134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116417f-6a63-4986-b810-7b0eaa919012 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:15.967629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:15.968207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:15.968484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:15.968764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:15.980253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:15.985418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:15.986342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:15.987201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 521/1045] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:15.992358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.022020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a9bf7-7043-449f-a7a6-4cfb802c354e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.026591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.062244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.062925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.063196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.063457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.072261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.073710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:16.086085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:16.087642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:16.088745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 525/1046] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:16.097974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.100425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95578702-4815-45e3-9261-cbc88569ad59 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.138169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.141768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.142385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.142663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.143362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.144078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:16.144386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.145837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.155158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 522/1047] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:16.160836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.210057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ffe7-593f-402d-bcb2-127715328634 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.250717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.251324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.251600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.251914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.252648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:16.252911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.254351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.267798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 526/1048] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:16.272840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.277161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.288166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93deae-9a55-405d-ae55-77e93791cc85 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.326325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.326952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.327283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.327561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] PATH_INFO: `/v3/users/fac5312b9a814a21985a8f7d9760f68c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.345735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] RBAC: Authorizing `identity:get_user(user_id=fac5312b9a814a21985a8f7d9760f68c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.347276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.349281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 523/1049] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/users/fac5312b9a814a21985a8f7d9760f68c => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:16.355684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.386086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.392389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160c8d4-bc15-4e93-8f8f-46e7a0003168 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.426891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.427494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.427862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.428138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.428853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] RBAC: Adding query filter params (role.id=d7f7ac84722f4f0faa953c923ecd6753, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:16.429154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.430723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.436304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 527/1050] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=d7f7ac84722f4f0faa953c923ecd6753 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:16.473524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fbe1-1a23-4272-ac6c-f10685138e2d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.513798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.514338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.514616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.514886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.535439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.590699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.591417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.697273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 524/1051] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:03:16.703307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.815515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0108ea-0eaa-4dac-9e36-7737113ff9f1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:16.850661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:16.851292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:16.851572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:16.851877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:16.853569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:16.855269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7a7bd-37f9-4724-ad52-238b0e8b1ce1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:16.857085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 528/1052] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:16.862971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:16.916697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:16.969226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c037fe-c5f3-4894-a0eb-754f14f0d7c3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:17.004016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:17.004628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.004905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.005175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.005891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=f5356c25b4554b2494e188be4a39bbae, user.id=fac5312b9a814a21985a8f7d9760f68c) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:17.006194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:17.007623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a8637-4193-49f9-a1e3-32c26176abd6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:17.014055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 525/1053] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:16 2022] GET /identity/v3/role_assignments?user.id=fac5312b9a814a21985a8f7d9760f68c&scope.project.id=f5356c25b4554b2494e188be4a39bbae&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:17.034403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664010-fc24-4340-b352-805325e55188 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.034935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664010-fc24-4340-b352-805325e55188 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.034935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664010-fc24-4340-b352-805325e55188 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.036598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 529/1054] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:17.043068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.043362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.043611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.063103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:17.064365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:17.136904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 526/1055] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:17.404186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5664010-fc24-4340-b352-805325e55188 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:17.432822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:17.506544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5664010-fc24-4340-b352-805325e55188 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:17.543181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:17.543821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.544096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.544359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] PATH_INFO: `/v3/services/image` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.544928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:17.546282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:17.555004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:17.556305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:17.557482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 530/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 18:03:17 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:17.562254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:17.612630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:17.667163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767132ff-5a81-4d4b-93e9-0f2bf9c38a61 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:17.699528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:17.700146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.700420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.700681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.701288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] RBAC: Adding query filter params (name=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:17.701582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:17.702925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:17.712067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 527/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:17.714066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:17.804512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:17.813427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d32fe-a1d9-4a3b-864f-411089be1337 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:17.847854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:17.848462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:17.848733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:17.848997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:17.849618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] RBAC: Adding query filter params (type=image) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:17.849912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:17.851261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78c5a3-cd10-4446-8298-b935b4dd1448 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:17.861089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 531/1058] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:17.862074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:17.968384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3de86-ab46-4524-845e-e1a6de5b301f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:17.977473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:18.004014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:18.004897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.005323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.005742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.006582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:18.008888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827e551-bfff-43bc-8190-2d57641de510 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:18.087826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 528/1059] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:03:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:03:18.372466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007762-04b0-4b50-9abf-d14b560d1038 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.372984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007762-04b0-4b50-9abf-d14b560d1038 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.372984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007762-04b0-4b50-9abf-d14b560d1038 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.374442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 532/1060] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:18.380051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.380396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.380668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.399402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:18.400613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:18.475449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 529/1061] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:18.745139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007762-04b0-4b50-9abf-d14b560d1038 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:18.851194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007762-04b0-4b50-9abf-d14b560d1038 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:18.885514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:18.886132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.886404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.886672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.896694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-746e9ff5-3bf1-46e9-98f4-497b0416a6eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:18.901887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:18.902854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:18.903693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 533/1062] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:03:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:18.909689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:18.920971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def6cd-9c49-4bcb-b822-a3f971ecf820 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.921366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def6cd-9c49-4bcb-b822-a3f971ecf820 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.921639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24def6cd-9c49-4bcb-b822-a3f971ecf820 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.922961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 534/1063] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:18.928808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:18.929084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:18.929349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:18.951025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:18.952282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:18.966375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.015059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.024413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 535/1064] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:19.027253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d062f3d-32ab-4f4a-85ef-d90f0d93971d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.063630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.064275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.064558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.064822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.065485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:19.065786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.067158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.076191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 530/1065] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:03:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:19.082115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.203340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d29fec-d4ec-447a-af7e-8cdf57a25de3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.245644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.246279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.246558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.246828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.257789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.260459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.267337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:19.276482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:19.285117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:19.286119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:19.286119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:19.286119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:19.286119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 536/1066] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:19.286369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.290014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.395987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1b4b6-09fb-486e-b820-a641df1fb968 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.402151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d83e-021f-4f26-942d-14f267a42e88 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.432030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.432643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.432979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.433222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.433807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:19.434105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.435473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.440040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.440667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.440945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.441215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.453115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:19.453762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 531/1067] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:19.454549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:19.457882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:19.458821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:19.459655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 537/1068] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:19.465411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.476757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.527653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.570721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1fc7-bf92-42c7-9883-62a1394e2fdc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.572972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd637-287c-4b16-b4aa-9ffc209cf89b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.608279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.608810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.608932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.609179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.609407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.609506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.609678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.609950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.610598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:19.610951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.612359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.617038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.618893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.621896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 538/1069] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:19.627306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:19.633134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:19.634619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:19.635583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 532/1070] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:19.640910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.718245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.736003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7105a4-4492-4bbf-bf7e-ed6a0f9aa2e4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.751239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749fab-1c24-4f66-a909-b8e67256e285 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.757643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.773533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.774979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.775478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.775995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] PATH_INFO: `/v3/users/fac5312b9a814a21985a8f7d9760f68c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.777518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] RBAC: Authorizing `identity:get_user(user_id=fac5312b9a814a21985a8f7d9760f68c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.779238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.780899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 539/1071] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/users/fac5312b9a814a21985a8f7d9760f68c => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:19.786739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.796216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.797082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.797367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.797641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.798368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:19.798725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.800208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.818871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 533/1072] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:19.824993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.893420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86a0e-e482-4d4a-99e8-6b010cd458f7 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.929137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.929768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.930046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.930146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1efbe-7f1e-4e00-b2de-93a977c0dfb5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:19.930381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.931825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.933246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.934885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 540/1073] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:19.940741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:19.965323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:19.972191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:19.972923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:19.973225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:19.973532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:19.984880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:19.986467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:19.998396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:20.003662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:20.004706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:20.005603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:20.005603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:20.005603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:20.005603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 534/1074] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:20.011361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.047115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a9383-fda1-42a5-81ad-d47f405b9865 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.080643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.081294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.081573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.081846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae/users/fac5312b9a814a21985a8f7d9760f68c/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.083747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] RBAC: Authorizing `identity:create_grant(project_id=f5356c25b4554b2494e188be4a39bbae, user_id=fac5312b9a814a21985a8f7d9760f68c, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.085209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c754d10-2b07-4e41-b015-9376e40f1cbb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.113321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7a78-bc4b-429e-9c79-49b8a847ab35 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.145788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.146365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.146638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.146905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.147530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:20.147857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.149824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.150630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 541/1075] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:03:19 2022] PUT /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae/users/fac5312b9a814a21985a8f7d9760f68c/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:03:20.152512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32823a48-db02-4222-bf7f-56b3e54c4410 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.152808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32823a48-db02-4222-bf7f-56b3e54c4410 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.153082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32823a48-db02-4222-bf7f-56b3e54c4410 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.155808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 542/1076] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:20.163699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 535/1077] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:20.165791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.166201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.166510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.169896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.186479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:20.187701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:20.228950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:20.270932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 543/1078] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:20.302478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683c70-795a-48bc-8709-9e47a2eb05dc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.337076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.337698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.337970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.338237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.345201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.346661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:20.358509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:20.359411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:20.360345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 536/1079] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:20.365796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.416095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:20.471411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033b1a-cc12-4b39-82cb-bcd51b1f8573 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.507083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.507693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.508003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.508273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.509207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:20.509510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.510943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.527789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 544/1080] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:20.529962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.546205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.643643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f4f0a-9d5f-414d-a9d8-635b4495d9c2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.645241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:20.654855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcc93d-f036-414b-bbc2-fddb3085744b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:20.662617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:20.682667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.685573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.685573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.685573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/d7f7ac84722f4f0faa953c923ecd6753` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.686625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=f66707e00ece419d9cc33f09ba016e6f, role_id=d7f7ac84722f4f0faa953c923ecd6753)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.688176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.692712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:20.693310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:20.693603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:20.693852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:20.763103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 537/1081] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:03:20 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/f66707e00ece419d9cc33f09ba016e6f/roles/d7f7ac84722f4f0faa953c923ecd6753 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:03:20.767802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:20.769376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:20.883122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 545/1082] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:03:20.888927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:20.993344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d287f5-c858-4b8c-a171-b35ce0049be8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:21.028116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:21.028763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:21.029029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:21.029294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:21.039486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:21.041568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bc8635e6-b3fe-41e3-a1b7-a3f8eea1f650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:21.055975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:21.056947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:21.057830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:21.057830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:21.057830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:21.057830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 538/1083] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:21.062860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:21.072141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:21.163990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b722b8a-09f0-4580-8d00-528e89c98cf1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:21.199178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:21.199798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:21.200077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:21.200341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:21.200979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:21.201275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:21.202631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cbe2-8569-47c8-88e6-7668ca43950d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:21.216702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 546/1084] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:22.094599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0b17-88f5-415e-8fe7-7ca4008ce26e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.095164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0b17-88f5-415e-8fe7-7ca4008ce26e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.095164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa0b17-88f5-415e-8fe7-7ca4008ce26e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.096543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 539/1085] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:22.101970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.102647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.102647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.121217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:22.122387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:22.180691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:22.188405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 547/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:22.461022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa0b17-88f5-415e-8fe7-7ca4008ce26e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:22.478426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:22.565913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa0b17-88f5-415e-8fe7-7ca4008ce26e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:22.599633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:22.600275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.600549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.600817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.611086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a512f704-5090-4dad-90bd-ae70b8d21b56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:22.615650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:22.616873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:22.617781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 540/1087] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:22.622853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:22.662560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e310fc-be73-4e6f-bad4-89e0f0c6a3bc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.662946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e310fc-be73-4e6f-bad4-89e0f0c6a3bc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.663221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e310fc-be73-4e6f-bad4-89e0f0c6a3bc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.664689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 541/1088] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:03:22.669560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.669837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.670105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.688290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:22.689465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:22.722237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80fc9-645b-4998-b933-26dff510ba39 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:22.760444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 542/1089] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:22.761123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:22.762163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.762659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.763139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.764393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:22.764940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:22.767094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:22.775653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 548/1090] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:22.781386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:22.784733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:22.882975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8070b63-e80c-4a00-9c7c-aa574a9376c0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:22.917549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:22.918162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:22.918434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:22.918702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] PATH_INFO: `/v3/users/fac5312b9a814a21985a8f7d9760f68c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:22.919835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] RBAC: Authorizing `identity:get_user(user_id=fac5312b9a814a21985a8f7d9760f68c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:22.921255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:22.922891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 543/1091] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:22 2022] GET /identity/v3/users/fac5312b9a814a21985a8f7d9760f68c => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:22.928926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:22.986444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.027726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4bc1f-1f97-41c7-8675-355c897ca583 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.030802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.062347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.063256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.063535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.063829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.099849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.129248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc7d8-e547-4388-bc2e-f4269c80deaf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.131326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.132811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.162211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.162836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.163119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.163391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.173993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:23.179093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:23.180939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:23.182056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 544/1092] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:23.186892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.191264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.233204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 549/1093] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:23.238577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.289372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd045-f588-4e15-829b-516c2e378842 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.319238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.324466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.325066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.325369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.325634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.326288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:23.326583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.328091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.334574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8712581-2a2c-491f-8538-893e761fce31 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.341125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 545/1094] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:23.342113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.369633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.370257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.370534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.370806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.371959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.373401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.375032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 550/1095] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:23.381014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.408205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.444155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf5e2-176e-49cd-a088-c668808c79fa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.477435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.478057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.478331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.478593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.482078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f92715-dff4-40a5-88f6-84beba291cc4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.489321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.490783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:23.506283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:23.507271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:23.508910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:23.508910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:23.508910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:23.508910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 546/1096] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:03:23.514010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.522199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.522804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.523082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.523349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.524131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=f5356c25b4554b2494e188be4a39bbae, user.id=fac5312b9a814a21985a8f7d9760f68c) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:23.524442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.525865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.531734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 551/1097] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/role_assignments?user.id=fac5312b9a814a21985a8f7d9760f68c&scope.project.id=f5356c25b4554b2494e188be4a39bbae&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:23.562981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.679439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab2cda-b2ae-4116-ae37-a6cda8f62a33 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.714420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.715021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.715293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.715560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.716218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:23.716512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.717877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.729734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 547/1098] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:23.735693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:23.831966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:23.841366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418645-df1b-4eda-b7dc-7b45998e0ef8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:23.876608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:23.877251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:23.877523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:23.877790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] PATH_INFO: `/v3/users/nova` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:23.884740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:23.886165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:03:23.897475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:23.898618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:23.899853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 552/1099] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:23.904583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:24.002357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e199-4f2f-472e-a58c-755a32128240 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:24.010146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:24.035656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:24.036487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:24.036918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:24.037233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:24.038268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:24.038571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:24.040573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:24.058135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 548/1100] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 18:03:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:24.064121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:24.162886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c792bba-4e3f-4a42-acc5-0219542d7ace None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:24.196918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:24.197513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:24.197790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:24.198058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:24.216696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:24.268975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:24.270426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:24.364877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 553/1101] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:03:24.371565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:24.476259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3178b2-b325-4787-a4ab-50523a4d41ee None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:24.516093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:24.516734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:24.517009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:24.517278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:24.529195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:24.530645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:24.545902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:24.546977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:03:24.548362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:24.548362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:03:24.548362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:24.548362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 549/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:24.552743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:24.602952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:24.666644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e692c0-41d8-4462-a99d-262889100310 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:24.707499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:24.708230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:24.708509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:24.708773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:24.709414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:24.709709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:24.711080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:24.723774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 554/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:24.730465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:24.752062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:24.866804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37793-6a1a-4ca7-bacb-1768b594d174 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:24.905764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:24.906389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:24.906660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:24.906926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:24.918275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:24.919740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:03:24.931015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:24.932179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:03:24.933278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:24.933740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 550/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:24.940414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:25.056858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c4128-cb6a-42b9-a692-ab57a63740e3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:25.067671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:25.095709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:25.096355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:25.096663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:25.103325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:25.104129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:25.104438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:25.106145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74857b3d-9e64-4aec-b8ad-cd6c1de30880 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:25.119102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 555/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:03:25.125520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:25.234381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:25.265409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae596-e924-4718-88e9-7f1323d4c9e4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:25.309459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:25.309953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:25.310229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:25.310496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:25.311229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] RBAC: Adding query filter params (role.id=d7f7ac84722f4f0faa953c923ecd6753, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=f66707e00ece419d9cc33f09ba016e6f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:25.311529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:25.313010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820e525-f880-4a65-b6e5-14dd4d88f8fc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:25.319664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 551/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:25 2022] GET /identity/v3/role_assignments?user.id=f66707e00ece419d9cc33f09ba016e6f&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=d7f7ac84722f4f0faa953c923ecd6753 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:25.608671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21591a-f3a6-4444-8b7c-7bd937c380bf None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:25.609166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21591a-f3a6-4444-8b7c-7bd937c380bf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:25.609166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21591a-f3a6-4444-8b7c-7bd937c380bf None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:25.610463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 556/1107] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:25.616158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:25.616649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:25.616743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:25.635387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:25.636614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:25.706112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 552/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:25.974321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21591a-f3a6-4444-8b7c-7bd937c380bf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:26.079199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21591a-f3a6-4444-8b7c-7bd937c380bf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:26.113518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:26.114150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:26.114417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:26.114681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:26.115802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:26.117238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a4a2-b681-4b47-93df-45599582bfd4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:26.119497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 557/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:26.125239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:26.195204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:26.225762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50513a7-a422-486a-b771-ec6c7b794ed0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:26.260508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:26.261108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:26.261383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:26.261649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:26.262288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:26.263707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19867a-f148-4836-a4bc-25be5d5b959a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:26.362861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 553/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:03:26 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:28.298538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31a9e-4fa5-40cd-8846-e92a410ce128 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:28.299039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31a9e-4fa5-40cd-8846-e92a410ce128 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:28.299130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31a9e-4fa5-40cd-8846-e92a410ce128 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:28.300452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 558/1111] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:28.306396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:28.306778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:28.306925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:28.324363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:28.325545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:28.390092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 554/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:28.667581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31a9e-4fa5-40cd-8846-e92a410ce128 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:28.708175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:28.767949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31a9e-4fa5-40cd-8846-e92a410ce128 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:28.804940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:28.805569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:28.805848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:28.806118 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] PATH_INFO: `/v3/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:28.807566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] RBAC: Authorizing `identity:get_role(role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:28.808973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:28.810295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 559/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:28 2022] GET /identity/v3/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:28.816161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:28.872981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:28.916646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855e151-bbd8-4ae9-b9cc-3921ed1f9a01 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:28.948541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:28.949151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:28.949422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:28.949688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] PATH_INFO: `/v3/users/5d1857b597dc4b6caa6126d2a753642f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:28.962509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1857b597dc4b6caa6126d2a753642f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:28.964035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:28.965598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 555/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:28 2022] GET /identity/v3/users/5d1857b597dc4b6caa6126d2a753642f => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:28.971423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:29.068887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429cb4-5210-42cc-a922-916c715534f9 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:29.076500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:29.102410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:29.103404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:29.103685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:29.103984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:29.169416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:29.170860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:29.267546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 560/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:29.273508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:29.370243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b726b2-1721-43ee-8ebe-e236b13db213 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:29.384645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:29.404351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:29.404970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:29.405244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:29.405511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:29.406653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:29.408188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc94cd2-1053-4f70-a5a1-bef3a49314c2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:29.409785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 556/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:29 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:29.415965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:29.423933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:29.512728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c7bc-b33f-4886-bc33-e24ee524beb3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:29.544580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:29.545165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:29.545437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:29.545699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:29.546405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=f5356c25b4554b2494e188be4a39bbae, user.id=5d1857b597dc4b6caa6126d2a753642f) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:29.546702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:29.548150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf88c6c-7c0f-4477-9547-d911f74ef205 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:29.553286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 561/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:29 2022] GET /identity/v3/role_assignments?user.id=5d1857b597dc4b6caa6126d2a753642f&scope.project.id=f5356c25b4554b2494e188be4a39bbae&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:31.396658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f043-3b83-41a8-aedb-8f0e7ade5fdd None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:31.397209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f043-3b83-41a8-aedb-8f0e7ade5fdd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:31.397209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f043-3b83-41a8-aedb-8f0e7ade5fdd None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:31.398520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 557/1118] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:31.404209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:31.404606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:31.404745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:31.422345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:31.423510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:31.483309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:31.487605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 562/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:31.753689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f043-3b83-41a8-aedb-8f0e7ade5fdd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:31.851540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f043-3b83-41a8-aedb-8f0e7ade5fdd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:31.884970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:31.885585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:31.885860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:31.886130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] PATH_INFO: `/v3/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:31.887506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] RBAC: Authorizing `identity:get_role(role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:31.888894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:31.890177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 558/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:31 2022] GET /identity/v3/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:31.895774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:31.990970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c212-6f7f-4713-a3b0-15a046e48167 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:32.024205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:32.024743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:32.025023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:32.025299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] PATH_INFO: `/v3/users/5d1857b597dc4b6caa6126d2a753642f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:32.026399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1857b597dc4b6caa6126d2a753642f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:32.027994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:32.029546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 563/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:31 2022] GET /identity/v3/users/5d1857b597dc4b6caa6126d2a753642f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:32.035106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:32.084431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:32.133593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0445360-c37e-45dd-9b40-917a339d32eb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:32.166419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:32.167031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:32.167302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:32.167567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:32.168681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:32.170096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a395427-b8a4-4df0-b196-46b54fe6b4e5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:32.171678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 559/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:32 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:32.177696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:32.244258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:32.276372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658392f-8ad6-4675-a160-17ed124d4f41 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:32.310115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:32.310761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:32.311037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:32.311307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae/users/5d1857b597dc4b6caa6126d2a753642f/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:32.313421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5356c25b4554b2494e188be4a39bbae, user_id=5d1857b597dc4b6caa6126d2a753642f, role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:32.314853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdad76-d15b-473f-ad7e-d2c6549f4768 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:32.374154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 564/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:03:32 2022] PUT /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae/users/5d1857b597dc4b6caa6126d2a753642f/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:03:34.228351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9567d-2b04-4724-803b-02abff0f2807 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:34.228915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9567d-2b04-4724-803b-02abff0f2807 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:34.229006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9567d-2b04-4724-803b-02abff0f2807 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:34.230584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 560/1124] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:34.236285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:34.236663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:34.236818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:34.254348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:34.255529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:34.319347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 565/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:34.586474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9567d-2b04-4724-803b-02abff0f2807 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:34.685693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9567d-2b04-4724-803b-02abff0f2807 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:34.702423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:34.718407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:34.719021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:34.719293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:34.719562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] PATH_INFO: `/v3/roles/ee8b75fd070146ceacc209ae2e153ab4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:34.720945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] RBAC: Authorizing `identity:get_role(role_id=ee8b75fd070146ceacc209ae2e153ab4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:34.722302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:34.723583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 561/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:34 2022] GET /identity/v3/roles/ee8b75fd070146ceacc209ae2e153ab4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:34.729742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:34.787480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:34.829004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcdd63-88c9-4a36-a633-cfe8e78ad201 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:34.863092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:34.863862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:34.864372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:34.864694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] PATH_INFO: `/v3/users/5d1857b597dc4b6caa6126d2a753642f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:34.866375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] RBAC: Authorizing `identity:get_user(user_id=5d1857b597dc4b6caa6126d2a753642f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:34.868763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:34.870366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 566/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:34 2022] GET /identity/v3/users/5d1857b597dc4b6caa6126d2a753642f => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:34.876144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:34.973164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a4e4-23f9-4ea2-bc8b-b478ce4a9f11 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:35.005662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:35.006255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:35.006534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:35.006806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:35.059252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:35.072443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:35.074178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:35.169708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 562/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:35.175557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:35.272066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f87a-401f-4f49-85d1-a08dfd04c481 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:35.296497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:35.304750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:35.308663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:35.308663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:35.308663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] PATH_INFO: `/v3/projects/f5356c25b4554b2494e188be4a39bbae` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:35.308663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] RBAC: Authorizing `identity:get_project(project_id=f5356c25b4554b2494e188be4a39bbae)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:35.309080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf010-80de-42c4-8d0a-afc38934a422 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:35.310686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 567/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:35 2022] GET /identity/v3/projects/f5356c25b4554b2494e188be4a39bbae => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:35.316934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:35.397856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:35.412800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d970d3-40f8-49be-9e15-165bd7eafdbf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:35.446228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:35.446819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:35.447091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:35.447358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:35.448100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] RBAC: Adding query filter params (role.id=ee8b75fd070146ceacc209ae2e153ab4, scope.project.id=f5356c25b4554b2494e188be4a39bbae, user.id=5d1857b597dc4b6caa6126d2a753642f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:35.448404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:35.449817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ffc4d-32ec-42cb-be35-3131f9b4b1df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:35.455416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 563/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:35 2022] GET /identity/v3/role_assignments?user.id=5d1857b597dc4b6caa6126d2a753642f&scope.project.id=f5356c25b4554b2494e188be4a39bbae&role.id=ee8b75fd070146ceacc209ae2e153ab4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:37.380844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a42f-0ac3-4344-9e03-411661fb9172 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:37.381420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a42f-0ac3-4344-9e03-411661fb9172 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:37.381513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a42f-0ac3-4344-9e03-411661fb9172 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:37.382773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 568/1131] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:37.388508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:37.388935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:37.389050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:37.407139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:37.408357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:37.472659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 564/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:37.738831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a42f-0ac3-4344-9e03-411661fb9172 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:37.837567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a42f-0ac3-4344-9e03-411661fb9172 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:37.870300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:37.870903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:37.871174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:37.871439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:37.872559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:37.873979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b396c80-cbc6-49ff-8bc2-decc8893d6cb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:37.875497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 569/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:37.881160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:37.958578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:37.976366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a92fdb-9f8c-4349-80ad-c9ba0eecd9f0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:38.011336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:38.011899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:38.012183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:38.012453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:38.013088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:38.014507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1a7c5-f7a4-4a80-921c-755946683147 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:38.089129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 565/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:03:37 2022] POST /identity/v3/projects => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:03:40.016826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235a8d-97e4-4884-aea7-1e03ec1a4e98 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:40.017382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235a8d-97e4-4884-aea7-1e03ec1a4e98 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:40.017382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235a8d-97e4-4884-aea7-1e03ec1a4e98 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:40.018685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 570/1135] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:40.024660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:40.025085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:40.025203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:40.043324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:40.044455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:40.108627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 566/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:40.388709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235a8d-97e4-4884-aea7-1e03ec1a4e98 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:40.449989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:40.487887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235a8d-97e4-4884-aea7-1e03ec1a4e98 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:40.521060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:40.521671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:40.521945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:40.522210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:40.523310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:40.524886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19dc26-bb18-415d-8771-d04682d16f5c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:40.526433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 571/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:40.532205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:40.610608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:40.648398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc8fcd-dae2-4350-bddb-57bf84e9142a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:40.682562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:40.683156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:40.683429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:40.683693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:40.684354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:40.685763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3cfb0-69f5-4f12-abd2-59c664156a25 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:40.768265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 567/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:03:40 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:03:42.733868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8981a-df06-49cc-94da-dfd19dfd24de None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:42.734414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8981a-df06-49cc-94da-dfd19dfd24de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:42.734414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8981a-df06-49cc-94da-dfd19dfd24de None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:42.735738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 572/1139] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:42.740915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:42.741306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:42.741457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:42.759486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:42.760684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:42.824896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 568/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:43.095181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8981a-df06-49cc-94da-dfd19dfd24de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:43.194134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8981a-df06-49cc-94da-dfd19dfd24de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:43.222226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:43.228623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:43.229247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:43.229522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:43.229789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:43.240614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:43.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:43.246786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:43.247675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 573/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:43.252782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:43.300025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:43.350157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3a42-468c-4abf-8b35-3f421b273a37 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:43.382617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:43.383706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:43.384006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:43.384275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:43.384926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:43.385221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:43.386579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:43.394819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 569/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:43.401209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:43.498096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a50cc-2346-4074-bbd2-3c2e696a19b1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:43.531065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:43.531674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:43.531983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:43.532251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] PATH_INFO: `/v3/users/653de6c7a3fa4e2582c33bf417063c8e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:43.545468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=653de6c7a3fa4e2582c33bf417063c8e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:43.546891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:43.548493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 574/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:43 2022] GET /identity/v3/users/653de6c7a3fa4e2582c33bf417063c8e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:43.554361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:43.656973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197e880-5339-4bb9-855a-9e70f78392d3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:43.667893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:43.691567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:43.692210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:43.692528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:43.692797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:43.761489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:43.762932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:43.858068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 570/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:43.864020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:43.912577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:43.963926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ece61-ba40-4606-ae7c-de59db180ed2 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:43.996978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:43.997612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:43.997876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:43.998145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] PATH_INFO: `/v3/projects/20d2390c3c9f4697a74646bf0d5486c7` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:43.999257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] RBAC: Authorizing `identity:get_project(project_id=20d2390c3c9f4697a74646bf0d5486c7)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:44.000724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33732cc3-3324-476f-aa09-6880bcce30eb None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:44.002354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 575/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:43 2022] GET /identity/v3/projects/20d2390c3c9f4697a74646bf0d5486c7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:44.009189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:44.020455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:44.106013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b5477-a0ac-4eca-8fcd-56261ced795b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:44.139511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:44.140137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:44.140414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:44.140684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:44.141390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=20d2390c3c9f4697a74646bf0d5486c7, user.id=653de6c7a3fa4e2582c33bf417063c8e) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:44.141691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:44.143105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd578300-06a6-41a1-a795-951df94257b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:44.148287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 571/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:44 2022] GET /identity/v3/role_assignments?user.id=653de6c7a3fa4e2582c33bf417063c8e&scope.project.id=20d2390c3c9f4697a74646bf0d5486c7&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:46.054136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580591-eea3-44f4-8bff-0a6ee8fb81de None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:46.054677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580591-eea3-44f4-8bff-0a6ee8fb81de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:46.054677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580591-eea3-44f4-8bff-0a6ee8fb81de None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:46.056836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 576/1147] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:46.062055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:46.062454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:46.062591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:46.081040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:46.082203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:46.145908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 572/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:46.435649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4580591-eea3-44f4-8bff-0a6ee8fb81de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:46.533477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4580591-eea3-44f4-8bff-0a6ee8fb81de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:46.549678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:46.566763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:46.567379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:46.567656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:46.567961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:46.578251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:46.582849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:46.583990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:46.584901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:46.587912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 577/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:46.590553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:46.593714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:46.689907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d83b43-7fe3-4eb5-82eb-4f8be0057ca0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:46.722610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:46.723202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:46.723472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:46.723737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:46.724415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:46.724707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:46.726060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:46.734204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 573/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:46.740079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:46.837574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b38574-b5f9-4cda-a45f-012baae5f6a5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:46.870534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:46.871143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:46.871418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:46.871686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] PATH_INFO: `/v3/users/653de6c7a3fa4e2582c33bf417063c8e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:46.872825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] RBAC: Authorizing `identity:get_user(user_id=653de6c7a3fa4e2582c33bf417063c8e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:46.874347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:46.875925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 578/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:46 2022] GET /identity/v3/users/653de6c7a3fa4e2582c33bf417063c8e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:46.881703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:46.947824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:46.982002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6ea2-3860-4cf1-b6aa-3f1dee95c677 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:47.014716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:47.015332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:47.015609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:47.015913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] PATH_INFO: `/v3/projects/20d2390c3c9f4697a74646bf0d5486c7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:47.017021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] RBAC: Authorizing `identity:get_project(project_id=20d2390c3c9f4697a74646bf0d5486c7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:47.018451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a5db9-c6dc-4785-9b12-15066b7074e6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:47.020080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 574/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:46 2022] GET /identity/v3/projects/20d2390c3c9f4697a74646bf0d5486c7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:47.026211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:47.071507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:47.124771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacdd88-48be-45ea-8712-c113753d206a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:47.157374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:47.158012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:47.158289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:47.158561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] PATH_INFO: `/v3/projects/20d2390c3c9f4697a74646bf0d5486c7/users/653de6c7a3fa4e2582c33bf417063c8e/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:47.160471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] RBAC: Authorizing `identity:create_grant(project_id=20d2390c3c9f4697a74646bf0d5486c7, user_id=653de6c7a3fa4e2582c33bf417063c8e, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:47.161895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56802850-f4d0-4468-a6db-2aeaef80cd79 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:47.271852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 579/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:03:47 2022] PUT /identity/v3/projects/20d2390c3c9f4697a74646bf0d5486c7/users/653de6c7a3fa4e2582c33bf417063c8e/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:03:49.137064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904edb-847f-448d-8884-372fad2f6591 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:49.137622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904edb-847f-448d-8884-372fad2f6591 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:49.137622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904edb-847f-448d-8884-372fad2f6591 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:49.138921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 575/1154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:49.144101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:49.144522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:49.144645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:49.162953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:49.164738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:49.230125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 580/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:49.496254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904edb-847f-448d-8884-372fad2f6591 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:49.596091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904edb-847f-448d-8884-372fad2f6591 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:49.629292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:49.629905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:49.630183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:49.630451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:49.632255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:49.641572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:03:49.646226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:49.647425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:03:49.649272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 576/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:49.654195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:49.688284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:49.754944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990258b7-d8d7-4446-961a-497e8838dfcf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:49.788343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:49.788999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:49.789222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:49.789564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:49.790235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:49.790533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:49.791923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:49.799823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 581/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:49.806320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:49.902827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6e749-2c3d-40ba-8696-bdd8b7358281 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:49.935607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:49.936259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:49.936532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:49.936803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] PATH_INFO: `/v3/users/653de6c7a3fa4e2582c33bf417063c8e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:49.937904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] RBAC: Authorizing `identity:get_user(user_id=653de6c7a3fa4e2582c33bf417063c8e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:49.939335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:49.940906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 577/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:03:49 2022] GET /identity/v3/users/653de6c7a3fa4e2582c33bf417063c8e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:49.947333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:50.038462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:50.044978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79b9f-02fe-4bab-b019-fd5c6a8e27c4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:50.079109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:50.079713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:50.080011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:50.080275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:50.145738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:50.147171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:50.235825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:50.242675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 582/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:50.248682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:50.307624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:50.345615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58944-fc70-4491-8e68-001ea4de2ddd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:50.379188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:50.379829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:50.380109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:50.380381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] PATH_INFO: `/v3/projects/20d2390c3c9f4697a74646bf0d5486c7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:50.381484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] RBAC: Authorizing `identity:get_project(project_id=20d2390c3c9f4697a74646bf0d5486c7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:50.382951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55600fa0-c827-4eca-afe6-89701bf2e505 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:50.384723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 578/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:03:50 2022] GET /identity/v3/projects/20d2390c3c9f4697a74646bf0d5486c7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:50.391058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:50.486998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ac23-eee4-4455-b08e-a66ff421cc13 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:50.519280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:50.519894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:50.520168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:50.520436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:50.521157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=20d2390c3c9f4697a74646bf0d5486c7, user.id=653de6c7a3fa4e2582c33bf417063c8e) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:50.521457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:50.522881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2f72d-974b-44eb-b361-7b4f2f36dace None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:50.528936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 583/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:03:50 2022] GET /identity/v3/role_assignments?user.id=653de6c7a3fa4e2582c33bf417063c8e&scope.project.id=20d2390c3c9f4697a74646bf0d5486c7&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:52.445673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12f8d-7011-4c58-892b-f23652aa6d2a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:52.446228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12f8d-7011-4c58-892b-f23652aa6d2a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:52.446228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12f8d-7011-4c58-892b-f23652aa6d2a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:52.447575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 579/1162] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:52.452987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:52.453414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:52.453514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:52.471198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:52.472402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:52.528027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:52.538703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 584/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:52.817371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12f8d-7011-4c58-892b-f23652aa6d2a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:52.915042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12f8d-7011-4c58-892b-f23652aa6d2a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:52.949087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:52.954561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:52.955157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:52.955428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:52.955810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:53.020710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:53.022144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:53.114935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 580/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:03:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:03:53.121751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:53.216071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e5a51-cf58-43b2-b5e1-b56f74001909 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:53.249827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:53.250442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:53.250712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:53.250978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:53.257445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:53.259226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9e9970f5-fb65-4835-9120-f71f657ab24c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:03:53.270295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:03:53.271495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:03:53.272406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 585/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:03:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:03:53.277378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:53.306992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:53.374054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97923b9b-872e-4f68-b295-f8cc2a9f899a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:53.406580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:53.407168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:53.407440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:53.407707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:53.408358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:03:53.408653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:53.410022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3d9d2-845f-4d79-be5b-81c9bf6c3264 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:53.417417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 581/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 18:03:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:55.328677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26210-1968-4a90-9644-0986f4903d7f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:55.329187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26210-1968-4a90-9644-0986f4903d7f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:55.329187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb26210-1968-4a90-9644-0986f4903d7f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:55.330528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 586/1167] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:55.336625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845345f5-065c-4710-8b7d-40d84113fbd6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:55.337230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845345f5-065c-4710-8b7d-40d84113fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:55.337230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845345f5-065c-4710-8b7d-40d84113fbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:55.357971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-845345f5-065c-4710-8b7d-40d84113fbd6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:55.359162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-845345f5-065c-4710-8b7d-40d84113fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:55.428543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 582/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:03:55.697769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb26210-1968-4a90-9644-0986f4903d7f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:55.749160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:55.798989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb26210-1968-4a90-9644-0986f4903d7f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:55.831792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:55.832375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:55.832649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:55.832912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:55.833566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:55.834921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becd891-1044-4a04-b336-4901ca000a76 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:55.906258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 587/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Aug 24 18:03:55 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:03:57.820975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926cd89-429c-4b3e-978f-d70223018f6d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:57.821513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926cd89-429c-4b3e-978f-d70223018f6d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:57.821513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926cd89-429c-4b3e-978f-d70223018f6d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:57.822893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 583/1170] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:03:57.828229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:57.828632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:57.828769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:57.846626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:03:57.847842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:03:57.915241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 588/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:03:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:03:58.180355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926cd89-429c-4b3e-978f-d70223018f6d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:58.204827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:58.281582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926cd89-429c-4b3e-978f-d70223018f6d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:58.313965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:58.314578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:58.314852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:58.315117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] PATH_INFO: `/v3/domains/ffaae440ab094cf18365d706b85dd8bc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:58.325651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=ffaae440ab094cf18365d706b85dd8bc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:58.327088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21a966-a875-46b1-908d-3265a059abfe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:58.328671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 584/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 24 18:03:58 2022] GET /identity/v3/domains/ffaae440ab094cf18365d706b85dd8bc => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:03:58.334499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:03:58.374800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:03:58.430821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5338f48-82d1-4a87-81bb-ddd13146d777 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:03:58.464656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:03:58.465257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:03:58.465532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:03:58.465797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:03:58.466423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:03:58.467871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb3170-52e7-4a42-a37d-6973c21ba7d4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:03:58.557927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 589/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:03:58 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:04:00.477195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48facae-871a-4857-a56c-ef7ad713c271 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:00.477776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48facae-871a-4857-a56c-ef7ad713c271 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:00.477776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48facae-871a-4857-a56c-ef7ad713c271 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:00.479056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 585/1174] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:04:00.485129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:00.485564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:00.485667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:00.504023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:04:00.505197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:04:00.571255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 590/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:04:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:04:00.846022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48facae-871a-4857-a56c-ef7ad713c271 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:00.931731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:00.948581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48facae-871a-4857-a56c-ef7ad713c271 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:00.985706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:00.986325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:00.986603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:00.986877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] PATH_INFO: `/v3/domains/ffaae440ab094cf18365d706b85dd8bc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:00.988019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ffaae440ab094cf18365d706b85dd8bc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:00.989448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea1b32-f081-48a4-89e2-e60762d28ba1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:00.991001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 586/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 24 18:04:00 2022] GET /identity/v3/domains/ffaae440ab094cf18365d706b85dd8bc => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:00.997308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:01.020735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:01.095453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab41f8-03c2-4595-baac-94b7c5ab787c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:01.128077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:01.128608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:01.128881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:01.129148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:01.129784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:01.131207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3c3fc-62f4-4852-b317-7091b17788b0 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:01.219013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 591/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:04:00 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:04:03.148777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715791-268d-4437-af30-ae0c9ef763f4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:03.149342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715791-268d-4437-af30-ae0c9ef763f4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:03.149342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80715791-268d-4437-af30-ae0c9ef763f4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:03.151227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 587/1178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:04:03.156617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:03.157045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:03.157146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:03.174734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:04:03.175932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:04:03.240631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 592/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:04:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:04:03.506473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715791-268d-4437-af30-ae0c9ef763f4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:03.606862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80715791-268d-4437-af30-ae0c9ef763f4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:03.639971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:03.640582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:03.640857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:03.641127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:03.650972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:04:03.655585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:04:03.656766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:04:03.657860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 588/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:04:03.662728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:03.673445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:03.763296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155f913-fbd6-4ca9-abe1-bcfbe36696f8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:03.795807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:03.796404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:03.796676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:03.796943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:03.797592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:04:03.797887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:03.799300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:03.807664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 593/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:03.813563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:03.828424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:03.911399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffa77a-9cae-4bcf-8b66-43dfc2663383 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:03.944965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:03.945648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:03.945918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:03.946185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] PATH_INFO: `/v3/users/40b8d43df791443d90d5bc7d79d9b99d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:03.959223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] RBAC: Authorizing `identity:get_user(user_id=40b8d43df791443d90d5bc7d79d9b99d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:03.961217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:03.962801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 589/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:04:03 2022] GET /identity/v3/users/40b8d43df791443d90d5bc7d79d9b99d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:03.968958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:04.036143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:04.065988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a9ce-ba55-4fb0-a3a7-41d502ca49b4 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:04.098085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:04.098669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:04.098941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:04.099206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:04.163037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:04.165089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:04.229187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:04.260061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 594/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:04:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:04:04.266113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:04.333245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:04.363126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678328ef-5247-4544-b967-ecfb3167b68b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:04.395714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:04.396359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:04.396634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:04.396899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] PATH_INFO: `/v3/projects/ba2544c40aa540bda6a04ea7fab6364c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:04.398677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] RBAC: Authorizing `identity:get_project(project_id=ba2544c40aa540bda6a04ea7fab6364c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:04.400281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d69131-7119-495c-bff8-eb37709d2a13 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:04.401878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 590/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:04:04 2022] GET /identity/v3/projects/ba2544c40aa540bda6a04ea7fab6364c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:04.408060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:04.502517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e0cd-20b2-44f6-bd3f-f1776972c02b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:04.536129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:04.536711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:04.536980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:04.537243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:04.537947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=ba2544c40aa540bda6a04ea7fab6364c, user.id=40b8d43df791443d90d5bc7d79d9b99d) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:04:04.538246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:04.539878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e28d5-fba7-444c-b069-ff87b2062251 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:04.544967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 595/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:04:04 2022] GET /identity/v3/role_assignments?user.id=40b8d43df791443d90d5bc7d79d9b99d&scope.project.id=ba2544c40aa540bda6a04ea7fab6364c&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:06.400818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abe33e-6677-48c7-93a2-ed3982e8752e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:06.401358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abe33e-6677-48c7-93a2-ed3982e8752e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:06.401358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abe33e-6677-48c7-93a2-ed3982e8752e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:06.402676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 591/1186] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:04:06.407925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:06.408342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:06.408439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:06.425976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:04:06.427138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:04:06.453429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:06.492816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 596/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:04:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:04:06.760228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abe33e-6677-48c7-93a2-ed3982e8752e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:06.858705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abe33e-6677-48c7-93a2-ed3982e8752e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:06.892076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:06.892690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:06.892963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:06.893231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:06.900494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:06.904211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:04:06.908788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:04:06.914777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:04:06.915864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 592/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:04:06.916712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:07.013266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068f65-d060-40e4-ad53-4253fb5d6d10 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:07.048273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391645-4b4e-431b-9707-34352171bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:07.048870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391645-4b4e-431b-9707-34352171bcad None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:07.049147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391645-4b4e-431b-9707-34352171bcad None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:07.049417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391645-4b4e-431b-9707-34352171bcad None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:07.050070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391645-4b4e-431b-9707-34352171bcad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:04:07.050368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391645-4b4e-431b-9707-34352171bcad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:07.051728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391645-4b4e-431b-9707-34352171bcad None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:07.059645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 597/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:07.065552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:07.164690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37bf3e-97e0-4f87-a40b-4f53d77ae9db None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:07.196979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:07.197600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:07.197878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:07.198148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] PATH_INFO: `/v3/users/40b8d43df791443d90d5bc7d79d9b99d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:07.199260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] RBAC: Authorizing `identity:get_user(user_id=40b8d43df791443d90d5bc7d79d9b99d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:07.200721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:07.202266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 593/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:04:07 2022] GET /identity/v3/users/40b8d43df791443d90d5bc7d79d9b99d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:07.207979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391645-4b4e-431b-9707-34352171bcad None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:07.236843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:07.308143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391645-4b4e-431b-9707-34352171bcad None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:07.341426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:07.342045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:07.342322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:07.342592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] PATH_INFO: `/v3/projects/ba2544c40aa540bda6a04ea7fab6364c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:07.343700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] RBAC: Authorizing `identity:get_project(project_id=ba2544c40aa540bda6a04ea7fab6364c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:07.345162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d8ac0-b3c9-4b54-bca8-1889f6235721 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:07.346780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 598/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:04:07 2022] GET /identity/v3/projects/ba2544c40aa540bda6a04ea7fab6364c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:07.352993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:07.417100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:07.451087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1239-0a4c-43b5-9e99-c5af6c55499b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:07.483596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:07.484263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:07.484536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:07.484803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] PATH_INFO: `/v3/projects/ba2544c40aa540bda6a04ea7fab6364c/users/40b8d43df791443d90d5bc7d79d9b99d/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:07.486658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] RBAC: Authorizing `identity:create_grant(project_id=ba2544c40aa540bda6a04ea7fab6364c, user_id=40b8d43df791443d90d5bc7d79d9b99d, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:07.488106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b3efb-0acf-40d0-a8f9-3ef4c04806cb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:07.554434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 594/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:04:07 2022] PUT /identity/v3/projects/ba2544c40aa540bda6a04ea7fab6364c/users/40b8d43df791443d90d5bc7d79d9b99d/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:04:09.454123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcf3-c8d7-467c-a9a1-7e08a31fd8bb None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:09.454682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcf3-c8d7-467c-a9a1-7e08a31fd8bb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:09.454682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcf3-c8d7-467c-a9a1-7e08a31fd8bb None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:09.456050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 599/1193] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:04:09.462056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:09.462475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:09.462574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:09.480638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:04:09.482053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:04:09.546092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 595/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:04:09.813852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492bcf3-c8d7-467c-a9a1-7e08a31fd8bb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:09.906653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:09.914018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492bcf3-c8d7-467c-a9a1-7e08a31fd8bb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:09.947775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:09.948409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:09.948684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:09.948955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:09.958594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:04:09.963458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:04:09.964549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:04:09.965590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 600/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:04:09.970609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:10.025383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:10.068160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f163f-50e8-4bd8-899d-b13c2d0ed586 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:10.101230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:10.101898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:10.102171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:10.102436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:10.103083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:04:10.103376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:10.104761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:10.112730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 596/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:10.119402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:10.216940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53951d-6721-4267-85ad-b89e5d82b8be None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:10.250140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:10.250758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:10.251034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:10.251304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] PATH_INFO: `/v3/users/40b8d43df791443d90d5bc7d79d9b99d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:10.252426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] RBAC: Authorizing `identity:get_user(user_id=40b8d43df791443d90d5bc7d79d9b99d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:10.253854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:10.255416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 601/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 18:04:10 2022] GET /identity/v3/users/40b8d43df791443d90d5bc7d79d9b99d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:10.261883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:10.358174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf981-afca-4336-a8de-b7029545f4b7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:10.374935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:10.390955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:10.391546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:10.391846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:10.392116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:10.458178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:10.459630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:10.554606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 597/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:04:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:04:10.560572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:10.584893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:10.657739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6a8-cd90-464f-8e43-5981fa603093 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:10.689582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:10.690188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:10.690464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:10.690727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] PATH_INFO: `/v3/projects/ba2544c40aa540bda6a04ea7fab6364c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:10.691844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=ba2544c40aa540bda6a04ea7fab6364c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:10.693266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6adc54-b2f6-41ac-b32f-b7feb461b3f4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:10.694991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 602/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 18:04:10 2022] GET /identity/v3/projects/ba2544c40aa540bda6a04ea7fab6364c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:10.701138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:04:10.719367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:10.814815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7911588-aa27-470c-a471-b26cda4617f2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:04:10.852663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:04:10.853265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:04:10.853545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:04:10.853815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:04:10.854529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=ba2544c40aa540bda6a04ea7fab6364c, user.id=40b8d43df791443d90d5bc7d79d9b99d) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:04:10.854839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:04:10.856567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a72519-5f99-42ca-b0af-fb327c5d359d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:04:10.862327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 598/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:04:10 2022] GET /identity/v3/role_assignments?user.id=40b8d43df791443d90d5bc7d79d9b99d&scope.project.id=ba2544c40aa540bda6a04ea7fab6364c&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:04:20.685654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=55 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:04:20.860167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=59 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:22.796667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a0f0-2269-49f2-a31b-7061de9fe113 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:22.797254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a0f0-2269-49f2-a31b-7061de9fe113 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:22.797254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434a0f0-2269-49f2-a31b-7061de9fe113 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:22.798565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 603/1201] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:22.803866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:22.804313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:22.804442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:22.823098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:22.824377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:22.895287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 599/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:23.167948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434a0f0-2269-49f2-a31b-7061de9fe113 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:23.270646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434a0f0-2269-49f2-a31b-7061de9fe113 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:23.303218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:23.303853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:23.304129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:23.304393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:23.314495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:23.315945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:23.330482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:23.336075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:23.337225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:23.337225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:23.337225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:23.337225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 604/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:23.337568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:23.435173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52237d-3a76-4d71-b48f-796fb8d4c320 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:23.462694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:23.468389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:23.468989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:23.469259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:23.469523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:23.470146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:23.470438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:23.471804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8d9e-b061-496b-b41a-34913360ed2d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:23.482763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 600/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:23.488673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:23.543406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:23.591953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bfc3d-859e-4662-adfe-2a7d51a0b31b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:23.625353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:23.625951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:23.626226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:23.626495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:23.627117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:23.628578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3542-1196-4d35-aed9-6f5a15e335b9 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:23.733699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 605/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 18:05:23 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:05:25.724826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506ee8b-4a07-4081-ad8d-045ccedcea1c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:25.725400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506ee8b-4a07-4081-ad8d-045ccedcea1c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:25.725400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506ee8b-4a07-4081-ad8d-045ccedcea1c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:25.726732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 601/1206] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:25.732814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:25.733251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:25.733354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:25.751960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:25.753478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:25.821126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 606/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:26.088059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506ee8b-4a07-4081-ad8d-045ccedcea1c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.188265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506ee8b-4a07-4081-ad8d-045ccedcea1c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:26.223285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:26.223949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:26.224224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:26.224486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:26.235080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:26.239837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:26.240962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:26.242049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 602/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:26.249270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.290752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:26.350992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae1f5-cfe7-4544-85b8-5f01abef8102 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:26.384832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:26.385420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:26.385692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:26.386698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:26.387413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:26.387728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:26.393315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:26.396920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 607/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:26.402687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.452372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:26.500141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175f84-facc-4956-992d-e48c02d3649d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:26.533238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:26.533859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:26.534138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:26.534408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:26.544868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:26.546309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:26.561370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:26.562395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:26.563361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:26.563361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:26.563361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:26.563361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 603/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:26.568451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.666117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:26.669570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8197100-d096-4c59-85c5-67b7478064b6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:26.702883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:26.703550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:26.704051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:26.704501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:26.705447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:26.705746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:26.707129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:26.719232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 608/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:26.725060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.826886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3fbf-c3d5-4f62-902b-216aa6a55166 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:26.828404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:26.860609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:26.861222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:26.861493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:26.861756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:26.868346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:26.869777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:26.880605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:26.888109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:26.889339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 604/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:26.890180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:26.991007 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c9f9-742d-4f7b-9e8b-2d5093f3f5cf None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:27.024300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:27.024897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:27.025175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:27.025470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:27.026193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:27.026533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:27.027993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:27.045394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 609/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:27.051224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:27.151202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39074507-6a13-484d-8765-3f5b40edf4fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:27.185639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:27.186271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:27.186550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:27.186811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:27.217635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:27.258230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:27.259633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:27.356911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 605/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:05:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:05:27.362962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:27.382738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:27.462176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe387d-6928-4bf8-bc9a-e451b426d856 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:27.499914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:27.500548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:27.500826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:27.501441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:27.516343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:27.517721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:27.532924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:27.534124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:27.535249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:27.535249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:27.535249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:27.535249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 610/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:27.539966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:27.603925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:27.647783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef7a-0186-40d8-b7bb-f1e1eba09d4d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:27.693400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:27.694016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:27.694308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:27.694556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:27.695196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:27.695489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:27.697109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:27.711749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 606/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:27.717849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:27.806247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:27.845482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2120-4954-47b0-8d43-5500e0cece92 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:27.904498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:27.905159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:27.905390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:27.905657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:27.914486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:27.916281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:27.931375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:27.932579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:27.933669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 611/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:27.938958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:28.057722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd822b84-85bc-4b29-ba9e-b878d9f461f2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:28.087024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:28.099869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:28.100514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:28.100797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:28.101067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:28.102348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:28.102881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:28.105859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd001b5-ed22-4048-a11d-dec56b40da22 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:28.119369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 607/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:28.126569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:28.252032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804de88e-0ad4-4546-b3ea-66510da973f3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:28.283098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:28.290554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:28.291305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:28.291586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:28.292575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:28.293480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:28.293785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:28.295251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2ff7-2c94-475b-a879-2efc252e9e88 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:28.306748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 612/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:05:28 2022] GET /identity/v3/role_assignments?user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:30.208731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500184d-0b19-44c1-a3b8-288d3ea02043 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:30.209296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500184d-0b19-44c1-a3b8-288d3ea02043 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:30.209296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500184d-0b19-44c1-a3b8-288d3ea02043 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:30.210636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 608/1220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:30.216413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:30.216862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:30.216969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:30.236155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:30.237349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:30.303876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 613/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:30.572178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500184d-0b19-44c1-a3b8-288d3ea02043 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:30.673702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500184d-0b19-44c1-a3b8-288d3ea02043 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:30.707239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:30.707889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:30.708167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:30.708450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:30.718279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:30.722928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:30.730283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:30.731172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 609/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:30.732425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:30.828847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383d63-8678-4e84-a8f4-488e1c7a6864 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:30.852212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:30.863494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:30.864125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:30.864575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:30.864775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:30.865350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:30.865646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:30.867009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:30.875330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 614/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:30.881110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:30.925016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:30.980904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888bf5-0733-4e4a-8f0c-fe456d41d1ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.013745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.014362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.014632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.014898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.024573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.026013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:31.040669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:31.041789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:31.043506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:31.043506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:31.043506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:31.043506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 610/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:31.048431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.149033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f02c8-789a-4bcc-b2f1-7fc0e049af5e None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.182156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.182785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.183135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.183409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.184078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:31.184465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.185832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.201624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 615/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:31.207400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.304090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:31.311289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415348-21c7-499f-b041-56be3dcae8db None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.344342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.344966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.345310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.345582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.353390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.355420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:31.366847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:31.369222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:31.371011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 611/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:31.374674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.421125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:31.473744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eaa42-5cde-4a9e-97af-dcac47a50a1b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.506904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.507495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.507796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.508069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.508775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:31.509071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.510484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.528113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 616/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:31.533963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.635910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eedde0-b26d-493a-9752-8e47b4fcd449 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.669661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.670286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.670557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.670823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.681431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.683357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:31.697122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:31.699120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:31.700527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:31.700527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:31.700527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:31.700527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 612/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:31.704818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.809178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda11b9-45df-4b22-a84a-15bbbe8060d8 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:31.811446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:31.843373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:31.843999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:31.844275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:31.844543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:31.845196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:31.845491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:31.846882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:31.861375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 617/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:31.868774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:31.881451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:31.974786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a43e8-7636-4143-b80f-49d0cf7a9ba8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:32.015376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:32.016030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:32.016310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:32.016638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:32.024114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:32.025559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:32.036705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:32.043548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:32.044770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 613/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:32.045406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:32.142670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ce599-4955-4a52-839d-5d4b447bf112 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:32.175770 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:32.176376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:32.176646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:32.176914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:32.177632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:32.177928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:32.179473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940968b-7622-45b6-9b77-22ec43aadd9b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:32.193571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 618/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:32.199844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:32.266765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:32.302380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f620ee0-983d-46d2-8ca6-c3d75e728ad3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:32.335769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:32.336423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:32.336697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:32.337030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/48609f3d5dd94c5a9cf3fc0e18bf0aa5/roles/2429d4fa9b8949e59c30378266d6c923` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:32.352293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=48609f3d5dd94c5a9cf3fc0e18bf0aa5, role_id=2429d4fa9b8949e59c30378266d6c923)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:32.353716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441e57-e2d0-4b0b-9814-8380998010b8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:32.493477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 614/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:05:32 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/48609f3d5dd94c5a9cf3fc0e18bf0aa5/roles/2429d4fa9b8949e59c30378266d6c923 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:05:34.442366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a6d7-1ecf-4131-a7ea-df16d8fbb1c7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:34.442957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a6d7-1ecf-4131-a7ea-df16d8fbb1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:34.442957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a6d7-1ecf-4131-a7ea-df16d8fbb1c7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:34.444296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 619/1233] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:34.451008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:34.451491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:34.451994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:34.471273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:34.472565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:34.540089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 615/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:34.829315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6a6d7-1ecf-4131-a7ea-df16d8fbb1c7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:34.862464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:34.952699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6a6d7-1ecf-4131-a7ea-df16d8fbb1c7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:34.986076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:34.986690 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:34.986967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:34.987236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:34.999001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:35.005295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:35.006415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:35.007252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 620/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 18:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:35.013560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.076098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:35.129315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407746aa-e116-4036-9334-b7b6ee220da0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.162235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.162832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.163163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.163429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:35.164110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:35.164403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:35.165807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:35.174655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 616/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:05:35.180824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.270603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:35.286610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e700-2e0d-454f-97ad-f39e2b624df1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.319857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.320483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.320760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.321029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:35.330880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:35.332369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:35.347312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:35.348454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:35.349736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:35.349736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:35.349736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:35.349736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 621/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:35.355774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.458397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9bda-7d3f-49b0-8b55-e90505cb85d5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.467462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:35.491766 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.492384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.492670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.492941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:35.493572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:35.493872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:35.495496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:35.507211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 617/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:35.513295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.615072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd7783-fd4d-46ff-8031-156f9237427b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.649293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.649912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.650275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.650549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:35.654011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:35.664268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:35.665792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:35.677744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:35.684662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:35.685945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 622/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:35.686713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.786013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17152d44-0c33-4da3-acad-08596437ce8b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.821422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.822028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.822306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.822577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:35.823889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:35.827963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:35.827963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:35.844516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 618/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:05:35.850536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:35.955530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7790-07a1-44fb-8234-4fa2998eb7b3 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:35.990108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:35.990710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:35.990987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:35.991256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.056996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:36.063644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.065192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.162272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 623/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:05:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 18:05:36.169387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:36.197130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:36.271604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e9069-2eba-42c0-87fb-02cfba5067fa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:36.306136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:36.306763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:36.307089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:36.307314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.317373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.318833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:36.333145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:36.334132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:36.335271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:36.335271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:36.335271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:36.335271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 619/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:36.341230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:36.434021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:36.439446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44f013-59a5-4cf6-926d-6bfb69c45223 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:36.472904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:36.473502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:36.473831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:36.474100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.474738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:36.475034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.476491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.487862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 624/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:36.493681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:36.574592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:36.595688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69727d8-a488-4b41-aa68-2446e77eb0ba None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:36.630811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:36.631426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:36.631701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:36.631998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.638556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.640037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:36.650725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:36.652146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:36.653211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 620/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:36.657957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:36.757763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199fcb5-2c1a-4593-b77f-932eef6c1174 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:36.791998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:36.792673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:36.792951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:36.793223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.793929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:36.794214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.795654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433b65e-6f8b-4a84-bffb-964fff3dbdce None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.807930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 625/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:36.814097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:36.912884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1cae-37db-472f-8fdd-b1d4868f2b89 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:36.946666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:36.947259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:36.947534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:36.947903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:36.948812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] RBAC: Adding query filter params (role.id=2429d4fa9b8949e59c30378266d6c923, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:36.949114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:36.950557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8dad-2fdd-483c-96cf-6089050205b9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:36.956264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 621/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:05:36 2022] GET /identity/v3/role_assignments?user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=2429d4fa9b8949e59c30378266d6c923 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:38.946205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ecfaa-096b-4d63-8f50-d66d48f19466 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:38.946790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ecfaa-096b-4d63-8f50-d66d48f19466 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:38.946790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ecfaa-096b-4d63-8f50-d66d48f19466 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:38.948724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 626/1247] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:38.954015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:38.954452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:38.954550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:38.960751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:38.973253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:38.974433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:39.041248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 622/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:39.322834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ecfaa-096b-4d63-8f50-d66d48f19466 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:39.342258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:39.427427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ecfaa-096b-4d63-8f50-d66d48f19466 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:39.461454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:39.462070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:39.462347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:39.462613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:39.472961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:39.477565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:39.478675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:39.480652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 627/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:05:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:39.485930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:39.582676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87335-d2be-4438-ade4-1d156d1aa4bb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:39.612213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:39.617055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:39.617664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:39.617942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:39.618205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:39.618873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:39.619171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:39.620639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:39.628585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 623/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:05:39.634306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:39.717776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:39.740165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc2fa-ffdb-4baf-b454-b3d4b1678c11 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:39.773471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:39.774155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:39.774433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:39.774702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:39.786917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:39.791144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:39.802255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:39.803291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:39.804221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:39.804221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:39.804221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:39.804221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 628/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:39.810015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:39.912701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fec8cc-ce28-474e-97ef-978b877c71b5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:39.946759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:39.947357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:39.947629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:39.948690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:39.949172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:39.949496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:39.950848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:39.962423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 624/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:39.968546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:40.069535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca4ef0-0ef6-4b28-9c9e-d971a21b7a4a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:40.094922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:40.102396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:40.103003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:40.103275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:40.103544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:40.111179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:40.112642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:40.123669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:40.124875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:40.126043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 629/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:40.130967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:40.186078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:40.229022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd826-b690-42d0-8ddc-371295ad32c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:40.263683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:40.264316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:40.264589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:40.264856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:40.265566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:40.265864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:40.267347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:40.284158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 625/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:40.290078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:40.390653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a259-6f3e-4b5c-98b9-9615d2c80bd1 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:40.423773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:40.424385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:40.424655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:40.424916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:40.478304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:40.490815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:40.492378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:40.592979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 630/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:05:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:05:40.598856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:40.697723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53843ce-2977-4be9-8d93-44a0b436c5e4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:40.710642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:40.732740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:40.733360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:40.733633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:40.733917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:40.744133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:40.747939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:40.760090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:40.761209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:40.762305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:40.762305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:40.762305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:40.762305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 626/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:40.767230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:40.854525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:40.866173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231527e1-2b3a-4681-bcb4-05ce7361ad87 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:40.898820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:40.899414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:40.899689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:40.899985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:40.900612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:40.900908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:40.902319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:40.912909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 631/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:40.919448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:41.017057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01ce91-a1a9-4813-ad4d-02bdcd500ba7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:41.050366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:41.050986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:41.051260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:41.051525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:41.058682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:41.060151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:41.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:41.072093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:41.073192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 627/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:41.078127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:41.175522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cdb64-6fb5-49b5-84a9-1e6302ad386b None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:41.208342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:41.208948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:41.209226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:41.209496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:41.210180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:41.210484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:41.211947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642475-dd19-4ca5-9fc2-943bdd0a56cc None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:41.225089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 632/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:41.231060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:41.257863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:41.336994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f95c1-72b4-449f-bcba-ed39b5942a57 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:41.373048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:41.373759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:41.374138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:41.374497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:41.375300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:41.375689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:41.377422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87e111-a9fb-4cd1-87b0-554e87106eab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:41.382923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 628/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:05:41 2022] GET /identity/v3/role_assignments?user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:43.269320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b7c2-d541-416d-adad-49a64b8564ba None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:43.269826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b7c2-d541-416d-adad-49a64b8564ba None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:43.269930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b7c2-d541-416d-adad-49a64b8564ba None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:43.271284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 633/1261] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:43.276480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:43.276902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:43.277096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:43.295159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:43.296361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:43.364003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 629/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:05:43.634187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68b7c2-d541-416d-adad-49a64b8564ba None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:43.645091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:43.737914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68b7c2-d541-416d-adad-49a64b8564ba None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:43.771512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:43.772155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:43.772427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:43.772677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:43.783485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:43.788229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:43.789383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:43.790446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 634/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 18:05:43.798093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:43.816107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:43.911308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39574dca-b0a5-462c-8544-05cd239e1dd3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:43.944631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:43.945281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:43.945556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:43.945825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:43.946474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:43.946767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:43.948678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:43.956671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 630/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:43.962474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.028951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:44.061011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07e9b-910a-4fbd-82ee-a9802c090942 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.094085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.094713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.094985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.095253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.106151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.107888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:44.122843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:44.128713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:44.129822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:44.129822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:44.129822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:44.129822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 635/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:44.130113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.214510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:44.235468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffc32-deef-48db-8a07-9c9453c1aff5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.269140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.269733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.270008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.270281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.270905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:44.271202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.272578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.284059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 631/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:44.289998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.390282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef278d-3678-4c7b-a306-085c0a8bf126 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.409663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:44.423869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.424722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.424863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.425010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.432324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.433769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:44.444341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:44.448849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:44.450020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 636/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:44.451548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.556356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c190c-871c-4eb2-a27f-488421fc27c9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.589472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.590011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.590283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.590552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.591266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:44.591566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.593021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.602043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:44.610788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 632/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:44.616571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.715423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21353241-82f6-43d7-b50e-2db621381000 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.750057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.750674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.750948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.751218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.761548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.762986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:44.777117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:44.783304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:44.784471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:44.784471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:44.784471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:44.784471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 637/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:44.784759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.886294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2c3dc-5deb-4746-b4ec-5a17b795b49f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:44.919491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:44.920182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:44.920455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:44.920722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:44.921347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:44.921644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:44.922998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:44.934651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 633/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:05:44.940538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:44.971733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:45.038248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9248164-9c1b-44d9-b233-5a80a63bad58 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:45.071815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:45.072435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:45.072737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:45.073004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:45.079426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:45.080892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:45.092158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:45.096376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:45.097365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 638/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:45.099258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:45.158255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:45.199679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7b8d4-5472-4c87-902a-191b7cb22821 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:45.233041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:45.233642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:45.233914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:45.234226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:45.234901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:45.235198 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:45.236658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4795293-2f39-467e-a99f-a6ba1c0ace30 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:45.248810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 634/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:45.254731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:45.347128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:45.356315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df73-58d0-489e-a132-852e81e75a7c None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:45.390450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:45.391090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:45.391362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:45.391627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] PATH_INFO: `/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/48609f3d5dd94c5a9cf3fc0e18bf0aa5/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:45.393540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4939c9fe262467bbc01da9f6a974f75, user_id=48609f3d5dd94c5a9cf3fc0e18bf0aa5, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:45.395055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3d37-5333-4e0e-ae9b-600b9dc317a4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:45.516169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 639/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 18:05:45 2022] PUT /identity/v3/projects/c4939c9fe262467bbc01da9f6a974f75/users/48609f3d5dd94c5a9cf3fc0e18bf0aa5/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:05:47.409588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1795-88d4-4213-93f7-d66d5e64bd49 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:47.410142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1795-88d4-4213-93f7-d66d5e64bd49 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:47.410142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1795-88d4-4213-93f7-d66d5e64bd49 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:47.411494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 635/1274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:47.417030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:47.419473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:47.419473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:47.435730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:47.436929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:47.501806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 640/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:47.777641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1795-88d4-4213-93f7-d66d5e64bd49 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:47.880564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1795-88d4-4213-93f7-d66d5e64bd49 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:47.898166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:47.915368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:47.916014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:47.916302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:47.916571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:47.926461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 18:05:47.931076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:47.932191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:47.933380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 636/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 18:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:47.938827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.022113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:48.039550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291807-5ac2-4997-991e-f48aba70719a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.072349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.072970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.074036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.074272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.074919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:48.075211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.076593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:48.084419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 641/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 18:05:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:48.090444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.189069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd45a-54a0-4ef3-8216-6bd22aad6b78 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.222490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.223118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.223394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.223662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.234789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.236492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:48.251027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:48.252181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:48.253091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:48.253091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:48.253091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:48.253091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 637/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:48.258220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.356003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a4e0-3dda-468d-bac9-62794dd51d4d None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.389872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.390472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.390745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.391011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.391647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:48.391976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.393424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:48.405447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 642/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:48.411262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.445565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:48.520494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a4c4-a631-4b69-b199-caedbbc7c37d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.554049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.554669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.554948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.555225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.562850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.564354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 18:05:48.575477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:48.576609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:48.577979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 638/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:48.582379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.586096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:48.680225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898cbe-1265-4be3-98df-9d7f09024d4a None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.713649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.714356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.714634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.714901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.715625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:48.715958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.717419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:48.734850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 643/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 18:05:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:48.740621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:48.830612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:48.840423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650a5a7-31f3-4100-b943-ee6c2542097b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:48.873359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:48.878561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:48.878561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:48.878561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:48.953242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:48.954710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.043498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:49.053829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 639/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 18:05:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 18:05:49.059693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:49.120511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:49.161637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582010f-ebc0-4e38-85ce-b00c69f842f6 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:49.193329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:49.194008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:49.194540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:49.195032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:49.207233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:49.208650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 18:05:49.223407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:49.224702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 18:05:49.225798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 18:05:49.225798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 18:05:49.225798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:49.225798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 644/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:49.232045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:49.334446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242edf01-0a08-4060-80d8-29b920008c1d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:49.373310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:49.373909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:49.374189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:49.374461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:49.375122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:49.375427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:49.376892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.391371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 640/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 18:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:49.397302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:49.507224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0743b07-8325-4057-bdfd-099e5946fa13 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:49.523013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:49.544203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:49.544847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:49.545121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:49.545384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:49.552847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:49.554358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 18:05:49.569034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:49.570217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 18:05:49.571390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: ERROR keystone.server.flask.application Aug 24 18:05:49.575991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 645/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 18:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:49.576965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:49.629658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:49.680094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2057-81a9-4dd0-a1f9-864fd1a30c08 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:49.715449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:49.716092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:49.716370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:49.717427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:49.717427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:49.717616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:49.719097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd150c-3b9a-4f80-9b41-557ce3146c0f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.732303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 641/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 18:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:49.739019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:49.841834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f73e-83c4-446b-8f48-63f074c45aa5 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:49.876514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:49.877114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:49.877388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:49.877654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:49.878371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] RBAC: Adding query filter params (role.id=cfe0a4c208a6405884bcf1c12da0fa2d, scope.project.id=c4939c9fe262467bbc01da9f6a974f75, user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:49.878740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:49.880212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a27abb-876f-48de-96c3-9048080d3a54 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:49.886590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 646/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 18:05:49 2022] GET /identity/v3/role_assignments?user.id=48609f3d5dd94c5a9cf3fc0e18bf0aa5&scope.project.id=c4939c9fe262467bbc01da9f6a974f75&role.id=cfe0a4c208a6405884bcf1c12da0fa2d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:51.811592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2809-b33e-4fb0-bf21-867ca63f61c6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:51.812217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2809-b33e-4fb0-bf21-867ca63f61c6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:51.812217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2809-b33e-4fb0-bf21-867ca63f61c6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:51.813494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 642/1288] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:51.818632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:51.819034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:51.819221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:51.837079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:51.838256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:51.869609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:51.905468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 647/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:52.175366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2809-b33e-4fb0-bf21-867ca63f61c6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:52.277861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d2809-b33e-4fb0-bf21-867ca63f61c6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:52.289195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:52.313003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:52.313667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:52.313943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:52.314212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:52.314789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:52.316186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:52.324726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:52.325890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:52.327237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 643/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:05:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:52.331884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:52.428217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e315c-a28b-4627-8636-c234d21011da None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:52.461144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:52.461741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:52.462017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:52.462289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:52.462919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:52.463219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:52.464758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbeab3-964a-46da-9852-7979c2a3cb5a None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:52.469482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 648/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 18:05:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:52.475345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:52.575678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42239b47-dc0b-4331-ac98-511ffc7fa872 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:52.612827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:52.613413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:52.613685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:52.613951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:52.614561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:52.614855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:52.616243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f0b02-f3cd-4adc-8f33-9acb20f7ccd3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:52.620616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 644/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 18:05:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:54.504105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6d88-c241-4d17-a326-0584dcfc2bcf None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:54.504613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6d88-c241-4d17-a326-0584dcfc2bcf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:54.504613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b6d88-c241-4d17-a326-0584dcfc2bcf None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:54.505903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 649/1293] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:54.511112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8a5f3-2bf2-4d2b-8f58-c251758d35c9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:54.511520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8a5f3-2bf2-4d2b-8f58-c251758d35c9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:54.514523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8a5f3-2bf2-4d2b-8f58-c251758d35c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:54.529235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e7c8a5f3-2bf2-4d2b-8f58-c251758d35c9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:54.530429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e7c8a5f3-2bf2-4d2b-8f58-c251758d35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:54.559789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:54.595215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 645/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 18:05:54.859574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b6d88-c241-4d17-a326-0584dcfc2bcf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:54.890865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:54.961123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b6d88-c241-4d17-a326-0584dcfc2bcf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:54.995181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:54.995802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:54.996250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:54.996517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:54.997165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:54.998522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504647fc-9d47-4fa4-9dae-96c1cb2d1105 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:55.093457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 650/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 18:05:54 2022] POST /identity/v3/services => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:05:57.018338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3fe99-338b-4ad4-a14c-5bb43ab57a80 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.018894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3fe99-338b-4ad4-a14c-5bb43ab57a80 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.018894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3fe99-338b-4ad4-a14c-5bb43ab57a80 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.020239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 646/1296] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:57.025627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.026059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.026291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.043787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:57.048618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:57.115733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 651/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:05:57.385124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3fe99-338b-4ad4-a14c-5bb43ab57a80 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:57.486599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3fe99-338b-4ad4-a14c-5bb43ab57a80 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:57.519346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:57.519987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.520260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.520523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.521087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:57.522433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:05:57.530827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:05:57.531999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:05:57.533220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 647/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:05:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:05:57.538096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:57.556941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:57.636824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb02be-d890-411a-b55d-5e66f5186816 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:57.670067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:57.670712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.670991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.671262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.671919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:57.672220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:57.673582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:57.678531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 652/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 18:05:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:57.685380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:57.716473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:57.788829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af39f37-ef19-42da-8691-de13ec2f9fbb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:57.822949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:57.823537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.823836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.824101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.824877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] RBAC: Adding query filter params (interface=public, service_id=45c749b44f144125bce4eeef9c125a92, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:05:57.825179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:57.826530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb6250-5653-44de-a678-ae24fabdddc7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:57.831348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 648/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 18:05:57 2022] GET /identity/v3/endpoints?service_id=45c749b44f144125bce4eeef9c125a92&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:05:57.837221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:05:57.920443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:05:57.938848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb82ba-dee1-4e0a-8bc0-45ce5a199802 None admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:05:57.974917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:05:57.975585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:57.975897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:57.976166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:57.976771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:05:57.978145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f0d45-2c54-41e1-86e5-3bbfd75718f4 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:05:57.986874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 653/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 18:05:57 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:05:59.905650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f126-9d78-4b14-85e5-2e11bb9e084c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:59.906212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f126-9d78-4b14-85e5-2e11bb9e084c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:59.906212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f126-9d78-4b14-85e5-2e11bb9e084c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:59.907553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 649/1302] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:05:59.912736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:05:59.913117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:05:59.913268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:05:59.931635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:05:59.933036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:05:59.999206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 654/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:05:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 18:06:00.269573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1f126-9d78-4b14-85e5-2e11bb9e084c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:06:00.363688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:06:00.370972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1f126-9d78-4b14-85e5-2e11bb9e084c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:06:00.404192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:06:00.404821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:06:00.405096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:06:00.405356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:06:00.405933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:06:00.407285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 18:06:00.415880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 18:06:00.417709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 24 18:06:00.418548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 650/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 18:06:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 18:06:00.423700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:06:00.499788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:06:00.521744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff82d-ca09-4439-9cba-aee455300628 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:06:00.555612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:06:00.556242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:06:00.556519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:06:00.556787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] PATH_INFO: `/v3/services` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:06:00.558244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:06:00.558541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:06:00.560040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6f90-f111-48ff-96ff-a0c820366006 None admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:06:00.565078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 655/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 18:06:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:06:00.570845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:06:00.669815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075234d-2750-4913-b777-4b6e99ae49ef None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:06:00.702349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:06:00.702979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:06:00.703254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:06:00.703520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:06:00.704189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:06:00.705544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8f76e-68de-48cc-a941-8e824146df6f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:06:00.819440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 651/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:06:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:06:10.562164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=30 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:06:10.814508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:39.870550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf8644-2adc-498a-8491-8f4e586b2de6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:39.871955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf8644-2adc-498a-8491-8f4e586b2de6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:39.871955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf8644-2adc-498a-8491-8f4e586b2de6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:39.872542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 656/1307] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:11:39.878041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da116e7-21a1-4b8b-9d18-77cb6336b1db None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:39.878518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da116e7-21a1-4b8b-9d18-77cb6336b1db None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:39.878807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da116e7-21a1-4b8b-9d18-77cb6336b1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:39.969631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1da116e7-21a1-4b8b-9d18-77cb6336b1db None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:39.971047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1da116e7-21a1-4b8b-9d18-77cb6336b1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:40.128217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 652/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:40.416128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:40.416442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:40.416668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:40.418179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 657/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 24 18:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:40.425547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503f46-13f8-4fe6-a8b4-48deb61d4e30 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:40.426344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503f46-13f8-4fe6-a8b4-48deb61d4e30 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:40.426990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6503f46-13f8-4fe6-a8b4-48deb61d4e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:40.540995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e6503f46-13f8-4fe6-a8b4-48deb61d4e30 None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:40.542239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e6503f46-13f8-4fe6-a8b4-48deb61d4e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:40.564885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:40.629653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 653/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 24 18:11:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:40.639888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:40.642438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:40.780179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff0a0a-ac1e-4f3a-9562-2a6d11824f69 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:40.868109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:40.868742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:40.869042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:40.869332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:40.871178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:40.932941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:40.997022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:40.998520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c654b-d47c-4a97-b8d4-2f1639918758 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:41.018368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 658/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:43.242963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:43.243525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:43.243607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:43.250870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ede56-0dd0-4d3c-9f36-b3740d87083f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:43.251492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ede56-0dd0-4d3c-9f36-b3740d87083f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:43.251492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ede56-0dd0-4d3c-9f36-b3740d87083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:43.256351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 654/1312] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:43.337566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c63ede56-0dd0-4d3c-9f36-b3740d87083f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:43.338821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c63ede56-0dd0-4d3c-9f36-b3740d87083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:43.468888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 659/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:11:43.758242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:43.759890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:43.869296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85ca1c-8dcf-4349-bfcb-a22315971801 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:43.939859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:43.942355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:43.942959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:43.943234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:43.943513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:43.945128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:44.060875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:44.062219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe76f00-4d8d-4fea-8a8e-517aa2ac9384 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:44.080755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 655/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:46.483992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96608-6e47-45fd-9f60-a77c23327960 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:46.484561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96608-6e47-45fd-9f60-a77c23327960 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:46.484561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d96608-6e47-45fd-9f60-a77c23327960 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:46.486193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 660/1315] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:46.491196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8bed-8482-4090-a2ce-8cfa69661703 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:46.491576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8bed-8482-4090-a2ce-8cfa69661703 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:46.491732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8bed-8482-4090-a2ce-8cfa69661703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:46.557042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6edc8bed-8482-4090-a2ce-8cfa69661703 None None] MFA Rules not processed for user `4e85099d5b7741119941c9160b2618b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:46.558238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6edc8bed-8482-4090-a2ce-8cfa69661703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:46.609486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:46.653529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 656/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:46.951880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:46.958096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:46.958096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:46.958096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 661/1317] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 24 18:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:46.959638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90552fc7-d07f-4f5e-97e3-f8039f423c64 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:46.960016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90552fc7-d07f-4f5e-97e3-f8039f423c64 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:46.960289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90552fc7-d07f-4f5e-97e3-f8039f423c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:47.035544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-90552fc7-d07f-4f5e-97e3-f8039f423c64 None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:47.036784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-90552fc7-d07f-4f5e-97e3-f8039f423c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:47.110863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 657/1318] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 24 18:11:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:47.120950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:47.122465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:47.132179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:47.227427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c59e-2798-4e55-9cb3-a6617deae705 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:47.301292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:47.301892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:47.302168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:47.302436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:47.304056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:47.364482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:47.410160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:47.411602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f31d-f7f0-4199-ad29-f40556667676 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:47.429708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 662/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:50.459621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:50.460213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:50.460213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:50.461592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 658/1320] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:50.467748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622b46-8a99-49ef-bfc4-d32534a8bc7f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:50.468196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622b46-8a99-49ef-bfc4-d32534a8bc7f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:50.468315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622b46-8a99-49ef-bfc4-d32534a8bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:50.533040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4d622b46-8a99-49ef-bfc4-d32534a8bc7f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:50.534157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4d622b46-8a99-49ef-bfc4-d32534a8bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:50.627840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 663/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:50.914194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:50.916427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:50.966339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:51.019784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fee3bf-2c2c-4b1d-b8b6-ae46fd869510 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:51.090956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:51.091551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:51.091851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:51.092119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:51.093692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:51.194741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:51.207554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:51.209030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed5da-1bfc-4ee3-8e64-e24ceeb4687f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:51.227185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 659/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:54.163637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:54.164174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:54.164174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:54.165483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 664/1323] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:54.170725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9be53-ace3-4f15-bd4e-80a144a578e7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:54.171143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9be53-ace3-4f15-bd4e-80a144a578e7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:54.171236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9be53-ace3-4f15-bd4e-80a144a578e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:54.249812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c1c9be53-ace3-4f15-bd4e-80a144a578e7 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:54.251034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c1c9be53-ace3-4f15-bd4e-80a144a578e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:54.351150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 660/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:11:54.645742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:54.647382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:54.668630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:54.756626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c35b5-760b-44b5-87a4-9f54a734e220 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:54.830469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:54.831066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:54.831338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:54.831604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:54.833243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:54.906672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:54.945111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:54.946572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a837-2228-4319-83f8-18d9a9c37b5f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:54.964470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 665/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:56.929291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147710e-928f-4601-a18a-324a9625fcba None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:56.929853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147710e-928f-4601-a18a-324a9625fcba None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:56.929853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147710e-928f-4601-a18a-324a9625fcba None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:56.931194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 661/1326] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:56.936562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e72e1-661f-4888-bf35-f105f1e23022 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:56.936986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e72e1-661f-4888-bf35-f105f1e23022 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:56.937091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e72e1-661f-4888-bf35-f105f1e23022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:57.002015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2a4e72e1-661f-4888-bf35-f105f1e23022 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:57.003097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2a4e72e1-661f-4888-bf35-f105f1e23022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:57.099169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 666/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:11:57.382377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147710e-928f-4601-a18a-324a9625fcba None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:11:57.385295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1147710e-928f-4601-a18a-324a9625fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:57.448837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:57.490449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147710e-928f-4601-a18a-324a9625fcba None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:11:57.563517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:11:57.564155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:57.564425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:57.564689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:57.566290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:57.680011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:11:57.683073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:11:57.684536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4bc4c-ddaf-40c7-b6f9-900994b0b3c5 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:11:57.702695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 662/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:11:59.694947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:59.695495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:59.695495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:59.696942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 667/1329] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:11:59.702514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80c1b-1cb2-4ad8-a8aa-10420191d984 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:11:59.702992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80c1b-1cb2-4ad8-a8aa-10420191d984 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:11:59.703086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80c1b-1cb2-4ad8-a8aa-10420191d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:11:59.771692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-65c80c1b-1cb2-4ad8-a8aa-10420191d984 None None] MFA Rules not processed for user `4e85099d5b7741119941c9160b2618b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:11:59.772920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-65c80c1b-1cb2-4ad8-a8aa-10420191d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:11:59.990442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 663/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:11:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:00.274252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:00.276591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:00.313180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:00.384808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc409b-ad7d-4797-a33c-3f8504de2ab6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:00.457111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:00.457704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:00.457977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:00.458241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:00.459827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:00.537703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:00.571028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:00.572732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979520ca-2d39-4c52-87fb-acb81c9de262 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:00.591426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 668/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:03.000355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:03.000900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:03.000900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:03.002284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 664/1332] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:03.007480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c667b-32ba-4e79-9355-d723dcca7bd1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:03.007936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c667b-32ba-4e79-9355-d723dcca7bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:03.008047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c667b-32ba-4e79-9355-d723dcca7bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:03.073144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-086c667b-32ba-4e79-9355-d723dcca7bd1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:03.074408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-086c667b-32ba-4e79-9355-d723dcca7bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:03.168637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 669/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:03.450243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:03.451790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:03.519413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:03.552300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc199ca5-d031-4ec0-afe1-a514ba08d67d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:03.631879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:03.632482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:03.632754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:03.633019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:03.635332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:03.741262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:03.742616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ad37-9b23-43fb-ab63-8d1df3054852 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:03.753151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:03.761232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 665/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:05.725496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:05.726019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:05.726019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:05.727520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 670/1335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:05.732916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a778-a385-44af-9485-7ed239eca495 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:05.733350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a778-a385-44af-9485-7ed239eca495 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:05.733447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9a778-a385-44af-9485-7ed239eca495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:05.798927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-67e9a778-a385-44af-9485-7ed239eca495 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:05.800150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67e9a778-a385-44af-9485-7ed239eca495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:05.895679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 666/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:12:06.181495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:06.183018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:06.224387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:06.289451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46fc6-c2d2-42d6-b979-0ef6815125fd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:06.365375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:06.365977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:06.366253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:06.366520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:06.368399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:06.449934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:06.475138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:06.476651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf0889-2b09-44d4-a993-568e089f2e65 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:06.497795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 671/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:09.004112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:09.004678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:09.004776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:09.006055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 667/1338] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:09.011886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c0286-d95e-4017-9fa3-b54b71fbf937 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:09.012288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c0286-d95e-4017-9fa3-b54b71fbf937 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:09.012428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c0286-d95e-4017-9fa3-b54b71fbf937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:09.078472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-018c0286-d95e-4017-9fa3-b54b71fbf937 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:09.079698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-018c0286-d95e-4017-9fa3-b54b71fbf937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:09.177048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 672/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:09.457362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:09.458881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:09.534533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:09.561720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ce6f-355c-45c7-8104-ae6eb11105de None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:09.648497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:09.649102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:09.649906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:09.650171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:09.651917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:09.757693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:09.759681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c615c4-7942-49b3-935f-de5835e307cd service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:09.777710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 668/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:14.159391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:14.159993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:14.159993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:14.161246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 673/1341] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:14.167060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79abd-96d5-42c2-8e1c-cfe6fdbc9cc3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:14.167520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79abd-96d5-42c2-8e1c-cfe6fdbc9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:14.167723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79abd-96d5-42c2-8e1c-cfe6fdbc9cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:14.173214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:14.241425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-62d79abd-96d5-42c2-8e1c-cfe6fdbc9cc3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:14.242715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-62d79abd-96d5-42c2-8e1c-cfe6fdbc9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:14.345002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 669/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:14.629129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:14.630654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:14.681529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:14.737087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970917-be3e-4a65-83c8-95d7109159cf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:14.810513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:14.811113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:14.811391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:14.811658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:14.813286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:14.907953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:14.924268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:14.925800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e649a-016b-4721-b713-b6d8ac73f6b7 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:14.945481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 674/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:17.756376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:17.756910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:17.756910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:17.758220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 670/1344] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:17.763506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0b7-70c1-4d2a-8e73-c591a6541878 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:17.764001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0b7-70c1-4d2a-8e73-c591a6541878 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:17.764117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0b7-70c1-4d2a-8e73-c591a6541878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:17.830971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2da8e0b7-70c1-4d2a-8e73-c591a6541878 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:17.832189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2da8e0b7-70c1-4d2a-8e73-c591a6541878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:17.928771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 675/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:18.213602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:18.215155 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:18.309855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:18.327584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2812-bade-43fd-ab52-50a3fff079e9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:18.403571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:18.404206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:18.404482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:18.404751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:18.406346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:18.517486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:18.519121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a17bc-b642-4233-8926-839da290e075 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:18.538621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 671/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:22.673588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:22.674132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:22.674132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:22.675470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 676/1347] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:22.681040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a121-c615-457e-b96f-027430e9012e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:22.681544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a121-c615-457e-b96f-027430e9012e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:22.681646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a121-c615-457e-b96f-027430e9012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:22.698271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:22.752881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8d98a121-c615-457e-b96f-027430e9012e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:22.754003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d98a121-c615-457e-b96f-027430e9012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:22.857382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 672/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:23.142543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:23.144113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:23.202146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:23.248662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f099ff-44e5-4032-83fb-0cae4de663e5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:23.325300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:23.325834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:23.326110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:23.326376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:23.328031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:23.435257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:23.438739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:23.440246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e602ceb-afc2-4962-a123-277ea9e1e2a7 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:23.459591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 677/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:28.385222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde80680-db91-4f89-a40a-17b1eb9eaae5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:28.386032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde80680-db91-4f89-a40a-17b1eb9eaae5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:28.386979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde80680-db91-4f89-a40a-17b1eb9eaae5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:28.389372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 673/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:28.395397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1267-46f5-4085-ad16-eae1f6a6c3fc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:28.395886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1267-46f5-4085-ad16-eae1f6a6c3fc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:28.396021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1267-46f5-4085-ad16-eae1f6a6c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:28.521538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-548c1267-46f5-4085-ad16-eae1f6a6c3fc None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:28.524460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-548c1267-46f5-4085-ad16-eae1f6a6c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:28.700770 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 678/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:12:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:32.855794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=59 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:32.868819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f547f9-5753-4a7d-a1d0-8f467c9843f3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:32.869113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f547f9-5753-4a7d-a1d0-8f467c9843f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:32.869372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f547f9-5753-4a7d-a1d0-8f467c9843f3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:32.878523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 674/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:32.878663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5c14-5355-4c65-a818-08cfb1a6cf75 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:32.878663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5c14-5355-4c65-a818-08cfb1a6cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:32.878663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b5c14-5355-4c65-a818-08cfb1a6cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:32.938302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:32.962646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0d5b5c14-5355-4c65-a818-08cfb1a6cf75 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:32.964257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0d5b5c14-5355-4c65-a818-08cfb1a6cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:33.079878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 679/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:12:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:34.483438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326c89-8197-437e-a0be-046c04e3c8e0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:34.484129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326c89-8197-437e-a0be-046c04e3c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:34.484129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326c89-8197-437e-a0be-046c04e3c8e0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:34.487088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 675/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:12:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:12:34.494442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da2b5-6bc9-4704-afd5-3a95dd3bddec None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:34.494991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da2b5-6bc9-4704-afd5-3a95dd3bddec None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:34.495134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23da2b5-6bc9-4704-afd5-3a95dd3bddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:34.571306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d23da2b5-6bc9-4704-afd5-3a95dd3bddec None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:34.572538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d23da2b5-6bc9-4704-afd5-3a95dd3bddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:34.633166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:34.711857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 680/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:12:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:12:38.086304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2e64-b3ad-4842-a5d0-6abaf3e5da6c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:38.086817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2e64-b3ad-4842-a5d0-6abaf3e5da6c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:38.086817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2e64-b3ad-4842-a5d0-6abaf3e5da6c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:38.088177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 676/1356] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:38.093476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f628-2a0b-470d-9510-be72b84506c1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:38.093960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f628-2a0b-470d-9510-be72b84506c1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:38.094060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f628-2a0b-470d-9510-be72b84506c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:38.162770 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-cbe2f628-2a0b-470d-9510-be72b84506c1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:38.164011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-cbe2f628-2a0b-470d-9510-be72b84506c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:38.294334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 681/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:38.598652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:38.599499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:38.600148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:38.602821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 677/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 18:12:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:38.612267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b890bc-829a-4ad8-b1f2-b92e3e2039dc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:38.612787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b890bc-829a-4ad8-b1f2-b92e3e2039dc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:38.613202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b890bc-829a-4ad8-b1f2-b92e3e2039dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:38.633866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:38.693218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b2b890bc-829a-4ad8-b1f2-b92e3e2039dc None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:38.694775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b2b890bc-829a-4ad8-b1f2-b92e3e2039dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:38.829781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 682/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:38.837891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:38.839639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:39.004220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677005f-42e5-4b22-bfa5-ba1630444446 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:39.097761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:39.149769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:39.150382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:39.150657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:39.150922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:39.153909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:39.252399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:39.253996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa9ca-c943-4610-8256-9a314ef837c9 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:39.274164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 678/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:41.465098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:41.465619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:41.465732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:41.467038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 683/1361] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:41.472418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d82f9-4646-476e-96f8-74f981ca6c70 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:41.472830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d82f9-4646-476e-96f8-74f981ca6c70 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:41.472911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d82f9-4646-476e-96f8-74f981ca6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:41.543293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-526d82f9-4646-476e-96f8-74f981ca6c70 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:41.544601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-526d82f9-4646-476e-96f8-74f981ca6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:41.585053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:41.655901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 679/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:41.948167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:41.949718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:42.023402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:42.116993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88db517-280a-4ad0-8bec-0f06f84bf4d0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:42.244658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:42.245350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:42.245700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:42.246043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:42.247768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:42.274357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:42.358893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:42.360631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971311e-bba9-45c8-a6f9-228757efe2eb service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:42.387563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 684/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:44.834275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1977cc-3511-489b-b1ba-2b51bf15a696 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:44.834884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1977cc-3511-489b-b1ba-2b51bf15a696 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:44.834884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1977cc-3511-489b-b1ba-2b51bf15a696 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:44.837105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 680/1364] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:44.842359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422db-1b32-40de-a98f-f0ac48963c9c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:44.842795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422db-1b32-40de-a98f-f0ac48963c9c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:44.842923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422db-1b32-40de-a98f-f0ac48963c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:44.910698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a73422db-1b32-40de-a98f-f0ac48963c9c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:44.912610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a73422db-1b32-40de-a98f-f0ac48963c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:45.014611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:45.017796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 685/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:45.310182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:45.310464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:45.311133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:45.312805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 681/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 18:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:45.318238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba355c8-1ed5-4f00-bf4d-f81eff18aee1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:45.322643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba355c8-1ed5-4f00-bf4d-f81eff18aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:45.322643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba355c8-1ed5-4f00-bf4d-f81eff18aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:45.400711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aba355c8-1ed5-4f00-bf4d-f81eff18aee1 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:45.401948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aba355c8-1ed5-4f00-bf4d-f81eff18aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:45.529364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 686/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:45.537107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:45.538629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:45.699663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1c37-33d2-43ee-94ab-72f3f17845cb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:45.721511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:45.825131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:45.825749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:45.826019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:45.826293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:45.827995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:45.923044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:45.924670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1bfe9-bb2c-4d2c-8eea-2020f586f727 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:45.944360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 682/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:46.437954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b44c-2f64-47c5-a5fb-fae2e3578394 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:46.438463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b44c-2f64-47c5-a5fb-fae2e3578394 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:46.438563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856b44c-2f64-47c5-a5fb-fae2e3578394 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:46.439991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 687/1369] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:12:46.445641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42603-1ee2-461a-b866-3c2d0cf4b1b4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:46.446002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42603-1ee2-461a-b866-3c2d0cf4b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:46.446276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42603-1ee2-461a-b866-3c2d0cf4b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:46.480152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:46.523061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c0c42603-1ee2-461a-b866-3c2d0cf4b1b4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:46.524502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c0c42603-1ee2-461a-b866-3c2d0cf4b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:46.627160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 683/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:47.211400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:47.211400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:47.211400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:47.212969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 688/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 24 18:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:47.220233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb215c4-a09f-473e-a680-9472c94568c0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:47.223841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb215c4-a09f-473e-a680-9472c94568c0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:47.223841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb215c4-a09f-473e-a680-9472c94568c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:47.313684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0fb215c4-a09f-473e-a680-9472c94568c0 None None] MFA Rules not processed for user `1a4fb108a9e6494f8465dc2e86911ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:47.314900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0fb215c4-a09f-473e-a680-9472c94568c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:47.364339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:47.396219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 684/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 24 18:12:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:47.404356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:47.406203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:47.459435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:47.518572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39bedd-3a3b-43bb-9813-edf140689e18 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:47.599895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:47.600502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:47.600777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:47.601047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:47.603910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:47.713929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:47.728794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:47.730635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec4dad-21d0-417f-80e8-461acd1ad382 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:47.752729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 689/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:12:48.071461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:48.071807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:48.072126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:48.073493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 685/1374] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:48.079154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854bdd-7ac7-4374-bdd4-8e76550699a4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:48.079465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854bdd-7ac7-4374-bdd4-8e76550699a4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:48.079740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854bdd-7ac7-4374-bdd4-8e76550699a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:48.145983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aa854bdd-7ac7-4374-bdd4-8e76550699a4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:48.147228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aa854bdd-7ac7-4374-bdd4-8e76550699a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:48.246544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 690/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:48.539878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:48.541421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:48.688647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1154-83eb-41f0-94bf-5bbfa2d0cd40 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:48.740548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:48.803677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:48.804906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:48.805354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:48.805627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:48.807221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:48.899775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:48.901368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7c6b4-3532-4ff0-a628-3261ff2fea53 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:48.919994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 686/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:51.100038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:51.100538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:51.100637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:51.102199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 691/1377] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:51.107523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc11f-826d-4ecd-82c2-84fc4c688e40 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:51.107984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc11f-826d-4ecd-82c2-84fc4c688e40 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:51.108106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc11f-826d-4ecd-82c2-84fc4c688e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:51.175458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-81ecc11f-826d-4ecd-82c2-84fc4c688e40 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:51.176703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81ecc11f-826d-4ecd-82c2-84fc4c688e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:51.184501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:51.286671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 687/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:51.601422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:51.603206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:51.676196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:51.765908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364958f1-1bda-4e5c-982f-1da8a7f082ce None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:51.892974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:51.893502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:51.893776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:51.894039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:51.895614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:51.914739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:51.990300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:51.992492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec887d0-9bb6-4c06-899c-66bde049c5be service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:52.012964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 692/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:54.098882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:54.099417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:54.099417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:54.100903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 688/1380] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:54.106855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c754-c10d-48dd-994c-086e46d33772 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:54.107323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c754-c10d-48dd-994c-086e46d33772 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:54.107421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c754-c10d-48dd-994c-086e46d33772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:54.178913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7390c754-c10d-48dd-994c-086e46d33772 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:54.180224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7390c754-c10d-48dd-994c-086e46d33772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:54.288179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:54.295860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 693/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:54.589248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:54.591063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:54.734995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:54.746682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2a69-e36b-403b-ba27-fe98e88b45cd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:54.871606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:54.872168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:54.872440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:54.872708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:54.874314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:54.971249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:54.972873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fd867-0cb3-44a3-819d-22f963075eb4 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:54.984573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:54.995258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 689/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:12:57.256271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:57.256855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:57.256855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:57.258328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 694/1383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:12:57.264135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682659-1c23-4bf1-b4cc-d4bec8fa85c5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:57.264603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682659-1c23-4bf1-b4cc-d4bec8fa85c5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:57.264892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682659-1c23-4bf1-b4cc-d4bec8fa85c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:57.342942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2e682659-1c23-4bf1-b4cc-d4bec8fa85c5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:12:57.344207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2e682659-1c23-4bf1-b4cc-d4bec8fa85c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:57.445516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 690/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:12:57.742471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:12:57.744108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:57.897998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4760ec-71f2-4ee2-95ee-a59a6c82413e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:12:57.967123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:12:58.025248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:12:58.025840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:12:58.026103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:12:58.026370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:12:58.028088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:12:58.120357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:12:58.121969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee88c1-1cf3-4ac1-949b-16789ab0b6e9 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:12:58.140573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 695/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:00.432543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:00.433187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:00.433187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:00.434391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 691/1386] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:00.440715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d74e-9fe1-4bdd-b952-f221c2b5748b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:00.441254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d74e-9fe1-4bdd-b952-f221c2b5748b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:00.441354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d74e-9fe1-4bdd-b952-f221c2b5748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:00.514532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e196d74e-9fe1-4bdd-b952-f221c2b5748b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:00.515774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e196d74e-9fe1-4bdd-b952-f221c2b5748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:00.548844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:00.614653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 696/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:00.981999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:00.983955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:01.084992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:01.172860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e35ee-7838-4249-89f8-c09994f6e391 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:01.304846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:01.305463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:01.305739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:01.306007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:01.307595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:01.347134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:01.404096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:01.405706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459451-570b-4a96-aa9c-febb7b006e1b service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:01.424547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 692/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:03.197365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638e30-3ec6-4e26-b3a6-728a04d67d86 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.197955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638e30-3ec6-4e26-b3a6-728a04d67d86 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.197955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638e30-3ec6-4e26-b3a6-728a04d67d86 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.199309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 697/1389] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:03.204678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5a7-0993-49be-b582-ba18da7cae0b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.205096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5a7-0993-49be-b582-ba18da7cae0b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.205293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5a7-0993-49be-b582-ba18da7cae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.278216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-137bf5a7-0993-49be-b582-ba18da7cae0b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:03.279476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-137bf5a7-0993-49be-b582-ba18da7cae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:03.376252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 693/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:03.480707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411762c-54c5-47c6-9682-a3dba3969c4a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.481084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411762c-54c5-47c6-9682-a3dba3969c4a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.481431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411762c-54c5-47c6-9682-a3dba3969c4a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.482930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 698/1391] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:03.488477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce579-208a-4eb9-9761-99c3e0c1b3cd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.488765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce579-208a-4eb9-9761-99c3e0c1b3cd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.489034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce579-208a-4eb9-9761-99c3e0c1b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.504503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:03.556855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-507ce579-208a-4eb9-9761-99c3e0c1b3cd None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:03.558053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-507ce579-208a-4eb9-9761-99c3e0c1b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:03.656571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 694/1392] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:13:03.683896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.684263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.684596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.686011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 699/1393] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 24 18:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:03.691113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:03.691401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:03.691676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:03.766877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] MFA Rules not processed for user `69f48db1a2504c9f80ceead1166e374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:03.768013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:03.802611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:03.845547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 695/1394] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 24 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:03.853455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:03.855022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:03.951642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:03.953034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:03.960993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1a4dc-b8df-46c5-b6c4-391f6b2700c4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:04.025416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:04.042943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:04.043582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:04.043932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:04.044241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:04.046295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:04.091121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078fb51-7fb0-4359-be44-0e48ffed53eb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:04.165654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:04.170718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:04.172317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f8a9d-f67b-453a-93c2-99bedaef2758 service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:04.192266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 700/1395] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:04.226475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:04.227445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:04.227728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:04.228062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:04.229618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:04.334266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:04.336266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5674d14-482c-420b-b282-4ec48ab5124f service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:04.354933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 696/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:05.108187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856039b9-09d5-4353-82f8-73f3e7fceb64 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:05.108704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856039b9-09d5-4353-82f8-73f3e7fceb64 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:05.108704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856039b9-09d5-4353-82f8-73f3e7fceb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:05.176406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-856039b9-09d5-4353-82f8-73f3e7fceb64 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:05.177642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-856039b9-09d5-4353-82f8-73f3e7fceb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:05.219106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:05.270844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 701/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:05.316862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:05.317335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:05.317437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:05.318746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 697/1398] 10.222.0.17 () {54 vars in 943 bytes} [Wed Aug 24 18:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:05.325659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339de57-1520-4dcb-aaa5-e68d569f36b8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:05.325949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339de57-1520-4dcb-aaa5-e68d569f36b8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:05.326226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339de57-1520-4dcb-aaa5-e68d569f36b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:05.404740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1339de57-1520-4dcb-aaa5-e68d569f36b8 None None] MFA Rules not processed for user `ab64f273e7554c40b7d7eac5f59eb3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:05.405847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1339de57-1520-4dcb-aaa5-e68d569f36b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:05.518207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 702/1399] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Aug 24 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:13:05.528617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:05.530134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:05.607337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:05.668613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe789e-b0d6-4bf1-8c9d-1690fcb72e68 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:05.773378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:05.773985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:05.774255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:05.774518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:05.776274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:05.842011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:05.864323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:05.865915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568bd97-d749-49f0-b8f1-1328c0c65a6a service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:05.876062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 698/1400] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:13:06.445890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:06.446434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:06.446434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:06.447767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 703/1401] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:06.453295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf165-2cb7-4dce-8982-b85ca11d84ab None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:06.453749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf165-2cb7-4dce-8982-b85ca11d84ab None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:06.453854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf165-2cb7-4dce-8982-b85ca11d84ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:06.531049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f71bf165-2cb7-4dce-8982-b85ca11d84ab None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:06.532450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f71bf165-2cb7-4dce-8982-b85ca11d84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:06.645921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 699/1402] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:06.946516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:06.948134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:06.963235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:07.115833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2003541-13be-4a8f-a0a9-d1df7483f0d6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:07.219375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:07.257931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:07.258572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:07.258845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:07.259119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:07.260780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:07.366057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:07.368224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88026e4-1865-4390-af9e-1c0733caac75 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:07.387415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 704/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:09.514255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:09.514852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:09.515236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:09.517404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 700/1404] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:09.525855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af623-f330-4ec2-a851-6a1280fa8cdd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:09.526808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af623-f330-4ec2-a851-6a1280fa8cdd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:09.527090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af623-f330-4ec2-a851-6a1280fa8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:09.609571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d18af623-f330-4ec2-a851-6a1280fa8cdd None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:09.610792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d18af623-f330-4ec2-a851-6a1280fa8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:09.668372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:09.721994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 705/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:10.014429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:10.015984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:10.079805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:10.191861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa74ca4-5f93-4ae2-90d4-00b9662a69df None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:10.340557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:10.341097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:10.341375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:10.341646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:10.343393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:10.358031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:10.450254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:10.451916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e158cb-1a80-4486-8a61-770676d4f33d service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:10.480608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 701/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:12.542893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:12.543461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:12.543461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:12.545183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 706/1407] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:12.550189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24b8-9ebe-4dd1-9e4a-569fcde42354 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:12.550660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24b8-9ebe-4dd1-9e4a-569fcde42354 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:12.550757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24b8-9ebe-4dd1-9e4a-569fcde42354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:12.621190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0f5c24b8-9ebe-4dd1-9e4a-569fcde42354 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:12.622403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f5c24b8-9ebe-4dd1-9e4a-569fcde42354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:12.726799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:12.741696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 702/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:13:13.036570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:13.038112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:13.197533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca20a1-c106-4832-8137-cb28d5a995c5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:13.236121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:13.344723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:13.345257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:13.345531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:13.345796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:13.351557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:13.457018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:13.458745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c9f78-2089-4639-9007-f3505a71eece service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:13.481436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 707/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:22.766125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:23.475038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:29.880907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88599-b6f1-439f-ac45-e8d39d8f6dc4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:29.881460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88599-b6f1-439f-ac45-e8d39d8f6dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:29.881460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e88599-b6f1-439f-ac45-e8d39d8f6dc4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:29.883355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 703/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 24 18:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:29.888413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aeca-9829-4d5f-8e89-f083f92a7d0a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:29.888881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aeca-9829-4d5f-8e89-f083f92a7d0a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:29.889000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1aeca-9829-4d5f-8e89-f083f92a7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:29.963599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bdb1aeca-9829-4d5f-8e89-f083f92a7d0a None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:29.964821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bdb1aeca-9829-4d5f-8e89-f083f92a7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:30.070649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 708/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:30.085055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bcaf-1d92-41c7-8111-5228d924c7c1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:30.086136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bcaf-1d92-41c7-8111-5228d924c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:30.086492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68bcaf-1d92-41c7-8111-5228d924c7c1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:30.087877 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 704/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 24 18:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:30.092615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d57f-52af-4e3c-89a4-a861d2ffcb24 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:30.092841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d57f-52af-4e3c-89a4-a861d2ffcb24 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:30.093113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d57f-52af-4e3c-89a4-a861d2ffcb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:30.165132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:30.167992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0765d57f-52af-4e3c-89a4-a861d2ffcb24 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:30.169214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0765d57f-52af-4e3c-89a4-a861d2ffcb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:30.287141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 709/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:32.705481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:32.706026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:32.706026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:32.707333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:32.713388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e3bd-79b6-4607-916a-ad42bc6e1986 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:32.713853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e3bd-79b6-4607-916a-ad42bc6e1986 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:32.713961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e3bd-79b6-4607-916a-ad42bc6e1986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:32.779525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7283e3bd-79b6-4607-916a-ad42bc6e1986 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:32.780748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7283e3bd-79b6-4607-916a-ad42bc6e1986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:32.834841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:32.877522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:33.170791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:33.172324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:33.320066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957f9c7-2dc1-4e0b-a26c-09f352d438a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:33.392392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:33.432454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:33.432978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:33.433247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:33.433508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:33.435077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:33.523471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:33.525098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5df74-c5d0-4866-a44a-065717c8ad7e service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:33.543406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 706/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:34.443867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:34.445015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:34.445015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:34.446265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:34.451318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e6f6-485f-413c-a626-60202f8ad774 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:34.451778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e6f6-485f-413c-a626-60202f8ad774 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:34.451899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e6f6-485f-413c-a626-60202f8ad774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:34.528275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7496e6f6-485f-413c-a626-60202f8ad774 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:34.529407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7496e6f6-485f-413c-a626-60202f8ad774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:34.556279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:34.626444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:34.776809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:34.778418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:34.921580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958e80-da1e-43bd-83df-3fda51b9fb1c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:34.961384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:35.033190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:35.033716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:35.033994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:35.034264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:35.035904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:35.127038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:35.128694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019d68f-da25-4ef9-b604-a2ac926dcc85 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:35.148773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 712/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:36.030735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:36.031299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:36.031299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:36.032623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:36.037722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3cfb1-54b8-40f9-a00b-c6f7d8677bcf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:36.038691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3cfb1-54b8-40f9-a00b-c6f7d8677bcf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:36.038829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3cfb1-54b8-40f9-a00b-c6f7d8677bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:36.093808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:36.115657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ead3cfb1-54b8-40f9-a00b-c6f7d8677bcf None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:36.117459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ead3cfb1-54b8-40f9-a00b-c6f7d8677bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:36.211770 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:36.363044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:36.364648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:36.509862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f354ad-2dd1-45de-9e6f-cb11f92cc1bf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:36.522343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:36.639435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:36.640074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:36.640348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:36.640618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:36.642737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:36.753156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:36.754771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873a31-8703-4359-92ac-73db9435852b service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:36.775840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 709/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:37.685420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:37.685961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:37.685961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:37.687200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:37.692209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094223-f9ea-4a44-bbe3-596c757c2eca None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:37.692606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094223-f9ea-4a44-bbe3-596c757c2eca None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:37.692745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094223-f9ea-4a44-bbe3-596c757c2eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:37.713089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:37.769591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-db094223-f9ea-4a44-bbe3-596c757c2eca None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:37.770830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-db094223-f9ea-4a44-bbe3-596c757c2eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:37.869376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:38.028408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:38.029953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:38.139535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:38.180930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921216-b0f6-49dc-b869-66694ba51359 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:38.294847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:38.295368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:38.295640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:38.295933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:38.297517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:38.373819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:38.386942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:38.388616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9451b-1480-43e9-9b75-406fcb64317a service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:38.407332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 715/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:39.274719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:39.275186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:39.275280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:39.276614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:39.281488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c732d08-66c3-4f2f-bb99-eea664caa625 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:39.281872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c732d08-66c3-4f2f-bb99-eea664caa625 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:39.282038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c732d08-66c3-4f2f-bb99-eea664caa625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:39.362395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5c732d08-66c3-4f2f-bb99-eea664caa625 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:39.363612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5c732d08-66c3-4f2f-bb99-eea664caa625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:39.459093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:39.612584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:39.614080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:39.697881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:39.759157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe1104-1a44-4d4a-8dff-4697995767cb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:39.870640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:39.871243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:39.871516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:39.871808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:39.873419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:39.921637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:39.962914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:39.964547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a517ca9-4004-4db6-a4b3-dc605af9d5d5 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:39.982407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 712/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:40.849003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:40.849570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:40.849570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:40.851523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:40.856637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6346-3d7b-4538-9eb4-6bb0159d8c84 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:40.857079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6346-3d7b-4538-9eb4-6bb0159d8c84 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:40.857187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6346-3d7b-4538-9eb4-6bb0159d8c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:40.942543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b1ad6346-3d7b-4538-9eb4-6bb0159d8c84 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:40.944540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b1ad6346-3d7b-4538-9eb4-6bb0159d8c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:41.049677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:41.203021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:41.204572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:41.255791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:41.353807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31bd43-5e1b-431c-8113-d35033608680 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:41.464446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:41.465045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:41.465317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:41.465582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:41.467167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:41.473849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:41.555164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:41.556796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a8cc4-bfa7-413e-b467-1ac9187aee5d service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:41.574334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 718/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:42.439554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:42.440127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:42.440242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:42.441507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:42.446330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e72c-9191-485b-9dbf-5c0b8994d3c8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:42.446714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e72c-9191-485b-9dbf-5c0b8994d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:42.446873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498e72c-9191-485b-9dbf-5c0b8994d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:42.522071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e498e72c-9191-485b-9dbf-5c0b8994d3c8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:42.523895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e498e72c-9191-485b-9dbf-5c0b8994d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:42.590137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:42.619779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:42.779368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:42.780824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:42.798299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:42.924474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fa172-1866-445a-adfe-55b8f5c30751 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:43.014861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:43.042518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:43.043019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:43.043288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:43.043554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:43.045222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:43.136941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:43.139659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a33d-d30f-4d14-b78f-84b83f95b362 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:43.158189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 715/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:44.017269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:44.017827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:44.017827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:44.019123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:44.025159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c663f8f-0218-43f4-ba68-2354c1a8e86f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:44.025609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c663f8f-0218-43f4-ba68-2354c1a8e86f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:44.025881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c663f8f-0218-43f4-ba68-2354c1a8e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:44.102731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6c663f8f-0218-43f4-ba68-2354c1a8e86f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:44.103896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c663f8f-0218-43f4-ba68-2354c1a8e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:44.145962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:44.201956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:13:44.356159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:44.357593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:44.503191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b888c-e2ca-4622-a19c-5f441390c69a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:44.557024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:44.615026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:44.615550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:44.615866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:44.616945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:44.618536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:44.709290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:44.711073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610b747-e6f2-40c6-9928-182fc87b268b service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:44.730608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 721/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:45.699247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:45.699845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:45.699845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:45.701143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:45.705954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c043-1469-445f-90f3-f3794da6446c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:45.706362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c043-1469-445f-90f3-f3794da6446c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:45.706505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c043-1469-445f-90f3-f3794da6446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:45.781668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-57a3c043-1469-445f-90f3-f3794da6446c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:45.782881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-57a3c043-1469-445f-90f3-f3794da6446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:45.784853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:45.881279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:46.032281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:46.033718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:46.177676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59525-e59e-42c5-b337-0e4f70a688c6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:46.204562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:46.291540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:46.292103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:46.292380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:46.292648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:46.294237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:46.382661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:46.384335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106633ac-356c-42af-8651-bb09b6eaf6d2 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:46.402520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 718/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:48.213853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:48.214402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:48.214402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:48.215714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:48.221012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67623f-9d6d-401b-ae5f-1a8f442a353c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:48.221457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67623f-9d6d-401b-ae5f-1a8f442a353c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:48.221565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67623f-9d6d-401b-ae5f-1a8f442a353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:48.263684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:48.288522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bf67623f-9d6d-401b-ae5f-1a8f442a353c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:48.289720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf67623f-9d6d-401b-ae5f-1a8f442a353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:48.386396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:13:48.671594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:48.673153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:48.776996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8530-7ba1-4261-be41-086a3d06641f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:48.809275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:48.849790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:48.850606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:48.850887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:48.851149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:48.852755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:48.962495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:48.964009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1ba8-9c16-46fc-8812-2ec93e0c34ac service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:48.982540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 724/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:51.035019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:51.035617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:51.035617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:51.036913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:51.042389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ebc3a-18a5-4faa-9788-2f55ad0578be None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:51.042825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ebc3a-18a5-4faa-9788-2f55ad0578be None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:51.042925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ebc3a-18a5-4faa-9788-2f55ad0578be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:51.107863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b52ebc3a-18a5-4faa-9788-2f55ad0578be None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:51.109085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b52ebc3a-18a5-4faa-9788-2f55ad0578be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:51.122624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:51.210629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:51.499305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:51.500850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:51.602330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253071bf-a36f-4d47-8b89-f39c5205c948 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:51.614568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:51.675258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:51.675892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:51.676175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:51.676414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:51.677996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:51.785781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:51.787125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df47d5-bc03-4e1d-b22b-978df680ab0a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:51.805741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 721/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:54.084168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:54.084728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:54.084865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:54.086090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:54.091417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78612-4a0e-441a-b02b-38508f2098e4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:54.091868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78612-4a0e-441a-b02b-38508f2098e4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:54.092024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78612-4a0e-441a-b02b-38508f2098e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:54.140287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:54.157903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7bd78612-4a0e-441a-b02b-38508f2098e4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:54.159105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7bd78612-4a0e-441a-b02b-38508f2098e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:54.259002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:54.541376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:54.542913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:54.648944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928adfc7-5fb2-4705-ae85-ef856a66123c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:54.688446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:54.722379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:54.722974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:54.723247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:54.723510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:54.725879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:54.834095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:54.836050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c075b8-6f68-4646-b90f-2a20778cc68a service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:54.855067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 727/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:56.889316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:56.889879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:56.889879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:56.891167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:56.896389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a6d-2512-4a91-87b4-8f6017851a9e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:56.896874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a6d-2512-4a91-87b4-8f6017851a9e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:56.899430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a6d-2512-4a91-87b4-8f6017851a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:56.962928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b4956a6d-2512-4a91-87b4-8f6017851a9e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:56.964163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b4956a6d-2512-4a91-87b4-8f6017851a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:56.984287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:57.061204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:13:57.348982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:13:57.351067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:57.453820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80189d09-e7ba-4725-a311-58acfb64c8c8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:13:57.473341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:57.526336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:13:57.526868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:57.527142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:57.527407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:57.529022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:57.636407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:13:57.637844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae57cc-123f-418b-9215-5c98f75ea575 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:13:57.656628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 724/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:13:59.619840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:59.620401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:59.620401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:59.622329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:13:59.627672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699df86-8c4d-4dda-925a-ea528e9d1080 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:13:59.628145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699df86-8c4d-4dda-925a-ea528e9d1080 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:13:59.628250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699df86-8c4d-4dda-925a-ea528e9d1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:13:59.695073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:13:59.697937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5699df86-8c4d-4dda-925a-ea528e9d1080 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:13:59.699136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5699df86-8c4d-4dda-925a-ea528e9d1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:13:59.795926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:00.080841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:00.082361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:00.194147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff5a4c-f338-4acf-8c6c-85c726ce4a34 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:00.364367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:00.388424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:00.389023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:00.389295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:00.389558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:00.391139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:00.497541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:00.499003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316b677-7aba-4aae-b001-4884b37be692 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:00.517274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 730/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:02.478384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:02.478944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:02.478944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:02.480354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:02.485697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137978-2851-463b-9490-9bedcf879781 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:02.486093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137978-2851-463b-9490-9bedcf879781 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:02.486199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137978-2851-463b-9490-9bedcf879781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:02.551438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ee137978-2851-463b-9490-9bedcf879781 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:02.552667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ee137978-2851-463b-9490-9bedcf879781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:02.581653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:02.649091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:02.937807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:02.939384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:03.045014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d517f9-dcb0-4206-a5eb-e10ba6c6d6bf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:03.072661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:03.119185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:03.119809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:03.120086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:03.120353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:03.121937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:03.230008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:03.231464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ae99a-653e-410c-a37a-9db33d178f49 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:03.250322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 727/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:05.210696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:05.211304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:05.211304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:05.212613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:05.218318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7df5-806b-4a55-82b0-08854f9d4778 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:05.218771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7df5-806b-4a55-82b0-08854f9d4778 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:05.218879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea7df5-806b-4a55-82b0-08854f9d4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:05.284761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-27ea7df5-806b-4a55-82b0-08854f9d4778 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:05.285980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-27ea7df5-806b-4a55-82b0-08854f9d4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:05.295215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:05.382889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:05.674091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:05.675652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:05.777276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e9202-ad4c-4efd-a25d-db2ebb2889c6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:05.832975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:05.851504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:05.853779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:05.853779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:05.853779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:05.854194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:05.961423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:05.962848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4bce-0901-4d16-8a56-9035867496ef service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:05.981164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 733/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:07.930763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:07.931294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:07.931415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:07.932709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:07.938112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aae58-a4cb-461d-a4f2-f00f2a10e0fe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:07.938518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aae58-a4cb-461d-a4f2-f00f2a10e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:07.938648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aae58-a4cb-461d-a4f2-f00f2a10e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:08.003517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-947aae58-a4cb-461d-a4f2-f00f2a10e0fe None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:08.004647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-947aae58-a4cb-461d-a4f2-f00f2a10e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:08.042095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:08.099933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:08.382721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:08.384310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:08.485576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa9f6-21f6-49db-bc6a-a2389f2b2ddf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:08.523736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:08.559616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:08.560314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:08.560594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:08.560847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:08.562439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:08.670001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:08.671356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669f10-5b3b-4a02-9e1c-a72ecdd8cd72 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:08.689447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 730/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:10.656842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:10.657646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:10.657646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:10.659193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:10.664831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1eeb1-8705-4174-9e48-a63f6b11b3d3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:10.665285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1eeb1-8705-4174-9e48-a63f6b11b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:10.665469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1eeb1-8705-4174-9e48-a63f6b11b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:10.730078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bcd1eeb1-8705-4174-9e48-a63f6b11b3d3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:10.731272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bcd1eeb1-8705-4174-9e48-a63f6b11b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:10.749897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:10.828185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:11.107350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:11.108936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:11.210925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bf8f4-d86c-4fb8-bf3a-133367ff7eed None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:11.278496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:11.284885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:11.285483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:11.285752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:11.286014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:11.288240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:11.410070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:11.412980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf32f98-736a-4ff3-a832-2bceb6e458b7 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:11.436525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 736/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:13.362919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:13.363455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:13.363455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:13.364824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:13.370254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b70f8-cc78-4630-8551-66e208563a98 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:13.370709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b70f8-cc78-4630-8551-66e208563a98 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:13.370817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b70f8-cc78-4630-8551-66e208563a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:13.441803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0a8b70f8-cc78-4630-8551-66e208563a98 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:13.443049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0a8b70f8-cc78-4630-8551-66e208563a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:13.493549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:13.543232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:13.826449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:13.828453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:13.934826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69fc7-b023-4d9e-9d17-c632d2a1cc6c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:13.981632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:14.007731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:14.008357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:14.008628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:14.008891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:14.010507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:14.118706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:14.120140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890f8c-92d2-4555-b8e6-1dff53966e48 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:14.138969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 733/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:23.541511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=22 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:24.136827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=66 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:33.637420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2433-0265-4580-83f6-63ed0058991d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:33.637993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2433-0265-4580-83f6-63ed0058991d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:33.637993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b2433-0265-4580-83f6-63ed0058991d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:33.639198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 738/1471] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:33.644382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fadf-b537-4c4d-af65-bf5fc6a90c38 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:33.644788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fadf-b537-4c4d-af65-bf5fc6a90c38 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:33.644917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fadf-b537-4c4d-af65-bf5fc6a90c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:33.710756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5fe0fadf-b537-4c4d-af65-bf5fc6a90c38 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:33.711995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5fe0fadf-b537-4c4d-af65-bf5fc6a90c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:33.807601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 734/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:34.109950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:34.110228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:34.110494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:34.111845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 739/1473] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 24 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:34.117439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7b59-2bce-4966-ae5a-0ae3aa3e9d14 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:34.117720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7b59-2bce-4966-ae5a-0ae3aa3e9d14 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:34.117992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7b59-2bce-4966-ae5a-0ae3aa3e9d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:34.193965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a66c7b59-2bce-4966-ae5a-0ae3aa3e9d14 None None] MFA Rules not processed for user `69f48db1a2504c9f80ceead1166e374a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:34.195173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a66c7b59-2bce-4966-ae5a-0ae3aa3e9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:34.215260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:34.274176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 735/1474] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 24 18:14:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:14:34.281709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:34.283196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:34.386950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6bdab-7edf-406c-85ea-824e6accb89c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:34.460063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:34.460654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:34.460946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:34.461214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:34.462793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:34.515269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:34.570584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:34.572052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08c318-ab93-405c-bfe3-9a30be060326 service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:34.591718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 740/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:36.566560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:36.567125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:36.567125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:36.568636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 736/1476] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:36.573802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4695-3770-435b-9bac-45a397e2802d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:36.574230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4695-3770-435b-9bac-45a397e2802d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:36.574335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4695-3770-435b-9bac-45a397e2802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:36.639264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-70ec4695-3770-435b-9bac-45a397e2802d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:36.640485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-70ec4695-3770-435b-9bac-45a397e2802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:36.735361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 741/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:37.012496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:37.013992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:37.137914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181360-3e6b-46af-bac4-25875caf87fc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:37.186859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:37.233213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:37.233743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:37.234022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:37.234288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:37.234919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:37.236667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:14:37.236667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:14:37.236667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:14:37.238066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0d55a-ffe1-4196-a56f-66d9e3cf24b4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:37.257132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 737/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 18:14:37 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:14:39.281648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:39.282239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:39.282344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:39.284269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 742/1479] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:39.290875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214cd6-cb09-4e50-b9bf-c2026c55c764 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:39.291398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214cd6-cb09-4e50-b9bf-c2026c55c764 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:39.291892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03214cd6-cb09-4e50-b9bf-c2026c55c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:39.369450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-03214cd6-cb09-4e50-b9bf-c2026c55c764 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:39.370677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-03214cd6-cb09-4e50-b9bf-c2026c55c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:39.467273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 738/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:39.768995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:39.771109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:39.781451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:39.926992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227bff-60cf-4c6c-b286-598c4d4c2c93 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:40.007037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:40.038556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:40.039517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:40.039820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:40.040097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:40.041741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:40.130030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:40.131620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f8de8-a2d4-4164-b16e-c22dbba82182 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:40.149154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 743/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:42.240152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:42.240605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:42.240800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:42.242279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 739/1482] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:42.247848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de6ce-b0f7-4a01-9187-1d3504484164 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:42.248257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de6ce-b0f7-4a01-9187-1d3504484164 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:42.248371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de6ce-b0f7-4a01-9187-1d3504484164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:42.314805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0d2de6ce-b0f7-4a01-9187-1d3504484164 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:42.316038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0d2de6ce-b0f7-4a01-9187-1d3504484164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:42.360981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:42.410438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 744/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:42.705148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:42.706734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:42.731073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:42.810845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a869ce-55c4-458e-83a7-1b8c383a0e89 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:42.884233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:42.884820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:42.885096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:42.885360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:42.886929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:42.962515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:42.996730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:42.998190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8e7ae-567f-45c1-9a42-3cdd0e0b9ea1 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:43.017433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 740/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:45.026033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:45.026610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:45.026610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:45.027977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 745/1485] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:45.033300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a88bd-a856-47c7-ab80-122538dc8eb8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:45.033749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a88bd-a856-47c7-ab80-122538dc8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:45.033855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a88bd-a856-47c7-ab80-122538dc8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:45.099618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-485a88bd-a856-47c7-ab80-122538dc8eb8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:45.100866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-485a88bd-a856-47c7-ab80-122538dc8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:45.200095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 741/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:45.502231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:45.503847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:45.607816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfcb8a-4eef-4578-bbc9-5738a4fbe6c7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:45.679925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:45.681692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:45.682291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:45.682563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:45.682829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:45.684459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:45.791146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:45.792555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273249-08ce-4820-bec0-6ca7fd08e857 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:45.810813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 746/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:47.911926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:47.912427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:47.912548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:47.913809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 742/1488] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:47.919148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3ce3-d829-4c42-bdfe-7cbc02a51403 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:47.919566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3ce3-d829-4c42-bdfe-7cbc02a51403 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:47.919689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3ce3-d829-4c42-bdfe-7cbc02a51403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:47.984206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0eda3ce3-d829-4c42-bdfe-7cbc02a51403 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:47.985398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0eda3ce3-d829-4c42-bdfe-7cbc02a51403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:48.039156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:48.083037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 747/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:14:48.384168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:48.385684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:48.422309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:48.491974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89054f4-7125-45a6-ade0-afb57a20b0c3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:48.564239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:48.564849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:48.565134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:48.565383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:48.567468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:48.652289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:48.680860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:48.682290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b6d42-5349-4ea1-9ba4-d67c5095fdfa service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:48.701826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 743/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:14:51.124443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:51.125020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:51.125020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:51.126348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 748/1491] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:14:51.131985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11835f2-9bb4-40bb-ba0b-6468e629298c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:51.132448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11835f2-9bb4-40bb-ba0b-6468e629298c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:51.132563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11835f2-9bb4-40bb-ba0b-6468e629298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:51.198254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a11835f2-9bb4-40bb-ba0b-6468e629298c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:14:51.199448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a11835f2-9bb4-40bb-ba0b-6468e629298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:51.302819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 744/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:14:51.589883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:14:51.591412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:51.692944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89d8e-c1ab-4bee-8935-cb161ab6298f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:14:51.764496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:14:51.765090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:14:51.765361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:14:51.765623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:14:51.767191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:14:51.776741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:14:51.874033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:14:51.875394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc50b3-bea8-48f0-aa9f-4c687bd0def3 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:14:51.893190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 749/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:15:01.300966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:15:01.890898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=50 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:23.385109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:23.385704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:23.385704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:23.461265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:16:23.462442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:23.557840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 745/1494] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:16:23.565854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:23.566342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:23.566448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:23.641693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:16:23.642892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:23.738996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 750/1495] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:16:23.744049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:23.745284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:23.756776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda3971-4cf2-4d0b-bf39-3f0dbdbf1163 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:23.817462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:23.850927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:23.851533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:23.851837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:23.852113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:23.852751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:16:23.853050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:23.854059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:23.854059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:16:23.854059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:16:23.854946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:23.866299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 746/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:16:23.874768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:23.883899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443a2e0-966b-48ed-ad29-6f5cbc778350 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:23.945587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:23.979893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:23.980493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:23.980763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:23.981027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:23.981633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:23.983350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:23.983350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:16:23.983350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:16:23.984571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:24.106813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 751/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:16:24.110905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:24.112509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:24.147838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4316-2ebd-494f-8022-56a9feee3088 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:24.240291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:24.240935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:24.241207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:24.241473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:24.242130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:24.243376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:24.243376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:16:24.243376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:16:24.244641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:24.359081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 747/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:16:24 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:16:24.363863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:24.365670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:24.430002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2ae9-baa3-4513-93ad-f7c2aa5a63b1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:24.515025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:24.525733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:24.526334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:24.526607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:24.526874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:24.527510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:24.528551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:24.528551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:16:24.528551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:16:24.529431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:24.541782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 752/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:16:24.545906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:24.547424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:24.559495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21798-d33b-4096-a467-3abf58777efe admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:24.584741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:24.654323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:24.654852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:24.655130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:24.655403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:24.656193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:24.657235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:24.657235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:16:24.657235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:16:24.658128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb025d4-f0d6-4605-8d03-bc6159ab2a4a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:24.671285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 748/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:16:24.676471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:24.677983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:24.713657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f04db-dfcf-48c8-8a2f-6b432c58ea5c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:24.806289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:24.806946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:24.807221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:24.807489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] PATH_INFO: `/v3/projects/f2e80a48d2a94e29854d1bc38af39449/users/5bfd464e973b4ba996f763d868b8ff42/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:24.829493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e80a48d2a94e29854d1bc38af39449, user_id=5bfd464e973b4ba996f763d868b8ff42, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:24.830525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:24.830525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:16:24.830525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:16:24.833250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcbef4-c11e-42ea-ae64-918950567fec admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:24.921808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 753/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:16:24 2022] PUT /identity/v3/projects/f2e80a48d2a94e29854d1bc38af39449/users/5bfd464e973b4ba996f763d868b8ff42/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:16:24.933865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f59a-444a-4a39-a9db-d4b4bf4aa47e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:24.937730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f59a-444a-4a39-a9db-d4b4bf4aa47e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:24.937730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f59a-444a-4a39-a9db-d4b4bf4aa47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:24.991886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e2e9f59a-444a-4a39-a9db-d4b4bf4aa47e None None] MFA Rules not processed for user `5bfd464e973b4ba996f763d868b8ff42`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:16:24.993086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2e9f59a-444a-4a39-a9db-d4b4bf4aa47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:25.069673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 749/1502] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:16:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:16:25.083197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:25.083479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:25.083772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:25.085130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 754/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 24 18:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:16:25.089896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0130-6440-4385-a315-0be7cbc0c2e9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:25.090175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0130-6440-4385-a315-0be7cbc0c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:25.090443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f0130-6440-4385-a315-0be7cbc0c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:25.121868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:25.166267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-958f0130-6440-4385-a315-0be7cbc0c2e9 None None] MFA Rules not processed for user `1a4fb108a9e6494f8465dc2e86911ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:16:25.167573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-958f0130-6440-4385-a315-0be7cbc0c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:25.243575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 750/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 24 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:16:25.251411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:25.252995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:25.303917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:25.356978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a38240-4740-4cd8-b846-e3690291b5a9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:25.429891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:25.430517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:25.430790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:25.431059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:25.432683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:25.529920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:25.531281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:25.535407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:25.549462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 755/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:16:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:16:25.594413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13e14-9e74-4a43-9e85-f2b7f730d4e8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:25.594862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13e14-9e74-4a43-9e85-f2b7f730d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:25.594967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f13e14-9e74-4a43-9e85-f2b7f730d4e8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:25.596288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 751/1506] 10.222.0.17 () {52 vars in 830 bytes} [Wed Aug 24 18:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:16:25.600453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:25.601651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:25.699695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ff1a-57a5-4df5-b2cd-4514e197b509 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:25.793945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:25.794487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:25.794756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:25.795018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] PATH_INFO: `/v3/users/5bfd464e973b4ba996f763d868b8ff42` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:25.807558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfd464e973b4ba996f763d868b8ff42)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:25.808671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:25.808671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:16:25.808671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:16:25.809869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:25.819459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:26.092421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfd464e973b4ba996f763d868b8ff42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:26.167233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfd464e973b4ba996f763d868b8ff42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:26.190230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfd464e973b4ba996f763d868b8ff42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:26.191184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfd464e973b4ba996f763d868b8ff42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:26.191696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfd464e973b4ba996f763d868b8ff42'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:26.211332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 756/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:16:25 2022] DELETE /identity/v3/users/5bfd464e973b4ba996f763d868b8ff42 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:16:26.215743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:26.217616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:26.217616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:26.274035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:16:26.275224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:26.350214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:26.362458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 752/1508] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:16:26.372230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:26.373450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:26.472532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ec730-e1b0-40f3-adc7-1783d2642c8e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:26.527923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:26.546335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:26.550459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:26.550459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:26.550459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:26.550459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:26.656900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:26.658255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c0a81-9173-4e09-9c0a-c78c05955117 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:26.677203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 757/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:16:27.188121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:16:27.189516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:16:27.202045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3127b70-248e-4e73-8ace-50af0b9447f2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:16:27.301869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:16:27.302494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:16:27.302764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:16:27.303030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] PATH_INFO: `/v3/projects/f2e80a48d2a94e29854d1bc38af39449` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:16:27.313132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e80a48d2a94e29854d1bc38af39449)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:16:27.314145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:16:27.314145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:16:27.314145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:16:27.315357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:16:27.428627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e80a48d2a94e29854d1bc38af39449', 'request_id': 'req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:27.442369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e80a48d2a94e29854d1bc38af39449', 'request_id': 'req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:27.500575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e80a48d2a94e29854d1bc38af39449', 'request_id': 'req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:27.524172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] The token cache is being invalidate because project f2e80a48d2a94e29854d1bc38af39449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:16:27.524454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:27.524875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-90ed7dcb-5f48-44a4-9d1d-4846b1ae8766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:16:27.526322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 753/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:16:27 2022] DELETE /identity/v3/projects/f2e80a48d2a94e29854d1bc38af39449 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:16:36.675058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=62 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:16:37.522191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:18:01.587143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:01.587876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:01.588026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:01.590183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:01.597241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db241e-175a-461e-a045-9adaaf6f731d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:01.598363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db241e-175a-461e-a045-9adaaf6f731d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:01.598771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db241e-175a-461e-a045-9adaaf6f731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:01.716077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b3db241e-175a-461e-a045-9adaaf6f731d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:01.717309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3db241e-175a-461e-a045-9adaaf6f731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:01.870563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:18:02.050433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:02.054587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:02.206661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad88cd6-bd4d-46bc-82d4-d94a065cc7ac None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:02.213434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:02.214056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:02.214338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:02.214603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:02.227785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:02.229689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5a39f-3899-4f6e-a888-ed61ce845925 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:02.245669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 759/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:03.173335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1c45-378a-456b-b4a7-2724a32d894d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:03.173937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1c45-378a-456b-b4a7-2724a32d894d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:03.174240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d1c45-378a-456b-b4a7-2724a32d894d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:03.176740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:18:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:03.183880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47006-711b-456f-9281-a9575d41fa2d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:03.184465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47006-711b-456f-9281-a9575d41fa2d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:03.184465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47006-711b-456f-9281-a9575d41fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:03.208768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-43b47006-711b-456f-9281-a9575d41fa2d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:03.210047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-43b47006-711b-456f-9281-a9575d41fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:03.219719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:03.408233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1c45-378a-456b-b4a7-2724a32d894d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:03.432485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d1c45-378a-456b-b4a7-2724a32d894d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:03.440822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:03.442675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:03.443154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:03.443609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:03.457847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:03.460231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db1e39-7ecb-4d1b-9e45-0a9c8eeb0afd service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:03.470875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 756/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:18:03.908070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41eb5-6402-47fd-bd5f-2af62362f56f None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:03.908525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41eb5-6402-47fd-bd5f-2af62362f56f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:03.908952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a41eb5-6402-47fd-bd5f-2af62362f56f None None] PATH_INFO: `/v3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:03.912482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 761/1517] 10.222.0.57 () {54 vars in 925 bytes} [Wed Aug 24 18:18:03 2022] GET /identity/v3 => generated 255 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:18:03.919894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992402ea-8f83-4f1c-8e45-814ef01fa908 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:03.920170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992402ea-8f83-4f1c-8e45-814ef01fa908 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:03.920442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992402ea-8f83-4f1c-8e45-814ef01fa908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:03.998812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-992402ea-8f83-4f1c-8e45-814ef01fa908 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:04.000066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-992402ea-8f83-4f1c-8e45-814ef01fa908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:04.020471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:18:04.096192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 757/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Aug 24 18:18:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:13.202504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=56 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:18:13.735361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b4ca-3b18-45d8-a825-dbf739357366 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:13.735652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b4ca-3b18-45d8-a825-dbf739357366 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:13.736088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b4ca-3b18-45d8-a825-dbf739357366 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:13.737414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 762/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 24 18:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:13.742931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16cbd-2c50-42fb-981c-d4f224f8ef28 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:13.743376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16cbd-2c50-42fb-981c-d4f224f8ef28 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:13.743483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16cbd-2c50-42fb-981c-d4f224f8ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:13.763664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-acc16cbd-2c50-42fb-981c-d4f224f8ef28 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:13.764894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-acc16cbd-2c50-42fb-981c-d4f224f8ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:13.774255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 758/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 24 18:18:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:13.781883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b4ca-3b18-45d8-a825-dbf739357366 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:13.799017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b4ca-3b18-45d8-a825-dbf739357366 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:13.804834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:13.805445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:13.805721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:13.805990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:13.814874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:13.816664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed0fe-6151-4b22-9a51-b3c71b94727b service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:13.826502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 763/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:14.702110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bde6-51b4-4eee-bff4-9631a256d12d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:14.702392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bde6-51b4-4eee-bff4-9631a256d12d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:14.702690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bde6-51b4-4eee-bff4-9631a256d12d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:14.704057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:14.709221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618cef-f08c-4207-8a60-87f614d2b7c0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:14.709741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618cef-f08c-4207-8a60-87f614d2b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:14.709741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618cef-f08c-4207-8a60-87f614d2b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:14.728544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-82618cef-f08c-4207-8a60-87f614d2b7c0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:14.734845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82618cef-f08c-4207-8a60-87f614d2b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:14.737537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:14.896487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444bde6-51b4-4eee-bff4-9631a256d12d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:14.910723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444bde6-51b4-4eee-bff4-9631a256d12d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:14.916203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:14.916793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:14.917088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:14.917352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:14.925586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:14.927126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdab78-c327-43e0-8381-67fb61ac5605 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:14.936406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 760/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:18:15.780419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e7c4c-678c-45ba-acb5-c72d08e628ce None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:15.780991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e7c4c-678c-45ba-acb5-c72d08e628ce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:15.780991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e7c4c-678c-45ba-acb5-c72d08e628ce None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:15.782381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 18:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:15.787237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40d5a0-278c-48d7-a36e-de974b437fff None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:15.787520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40d5a0-278c-48d7-a36e-de974b437fff None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:15.787811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40d5a0-278c-48d7-a36e-de974b437fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:15.806477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2b40d5a0-278c-48d7-a36e-de974b437fff None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:15.807655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2b40d5a0-278c-48d7-a36e-de974b437fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:15.815310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 18:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:15.966463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e7c4c-678c-45ba-acb5-c72d08e628ce None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:15.980733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e7c4c-678c-45ba-acb5-c72d08e628ce None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:15.986193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:15.986789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:15.987059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:15.987324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:15.996115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:15.997698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c59798-65b5-4f8c-b599-e3df107107ed service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:16.007310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 766/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:19.672813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:19.673357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:19.673357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:19.674604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:19.680699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1b9e-c258-455d-a031-53ec299f23b3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:19.681122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1b9e-c258-455d-a031-53ec299f23b3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:19.681281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b1b9e-c258-455d-a031-53ec299f23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:19.700367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d96b1b9e-c258-455d-a031-53ec299f23b3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:19.701556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d96b1b9e-c258-455d-a031-53ec299f23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:19.709912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:20.000807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:20.002473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:20.080186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6f92-efae-488e-8987-35c4df27fc13 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:20.084875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:20.085478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:20.085749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:20.086013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:20.094915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:20.096380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba4c4f-866e-4cd0-83ea-1e75f1218149 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:20.106050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 763/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:22.006598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f41ff-720f-4cbd-8027-a35d9bea2999 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:22.007264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f41ff-720f-4cbd-8027-a35d9bea2999 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:22.007264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f41ff-720f-4cbd-8027-a35d9bea2999 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:22.008511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:22.013820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3b76-9f02-40bc-a4f2-73228f302f3f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:22.014279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3b76-9f02-40bc-a4f2-73228f302f3f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:22.014385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3b76-9f02-40bc-a4f2-73228f302f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:22.034353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-293d3b76-9f02-40bc-a4f2-73228f302f3f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:22.036238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-293d3b76-9f02-40bc-a4f2-73228f302f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:22.043957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:22.333557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f41ff-720f-4cbd-8027-a35d9bea2999 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:22.344317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f41ff-720f-4cbd-8027-a35d9bea2999 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:22.348512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:22.349105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:22.349376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:22.349644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:22.358372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:22.359829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c4cf9-26a8-4d49-8b7d-3f90fc456687 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:22.370341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 769/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:25.832628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:25.833182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:25.833182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:25.834505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:25.839746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe49bd-6b13-40fd-a522-aa0c5a06748e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:25.840188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe49bd-6b13-40fd-a522-aa0c5a06748e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:25.840318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe49bd-6b13-40fd-a522-aa0c5a06748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:25.859864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6fbe49bd-6b13-40fd-a522-aa0c5a06748e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:25.861060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6fbe49bd-6b13-40fd-a522-aa0c5a06748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:25.869920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:18:26.431595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:26.433285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:26.498850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:18:26.512500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ea04-6417-405a-909e-46cfee36fcc3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:26.516282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:26.516886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:26.517159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:26.517425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:26.526495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:26.527991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eae5e4-9084-41e7-9c71-ec0ea25db0d1 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:26.537903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 766/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:18:28.449347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:28.449895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:28.449895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:28.451256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 18:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:18:28.457429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b21af-80d6-4116-ba26-02f74d185880 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:28.457885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b21af-80d6-4116-ba26-02f74d185880 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:28.457983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b21af-80d6-4116-ba26-02f74d185880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:28.476928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-221b21af-80d6-4116-ba26-02f74d185880 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:18:28.478112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-221b21af-80d6-4116-ba26-02f74d185880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:28.486178 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 18:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:18:29.047839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:18:29.049603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:18:29.063279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1742e-5299-4415-b7b1-c2bff5cce85d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:18:29.067711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:18:29.068335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:18:29.068613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:18:29.068881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:18:29.078845 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:18:29.080318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aec64-b9cc-46a0-8454-c27a6b59bdb0 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:18:29.089751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 772/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:18:38.473225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=11 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:18:39.085706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=33 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:04.038754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.039447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.039447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.068972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.070229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.082188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 768/1540] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.090851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e672-9600-4216-924f-5bf5cfa32af4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.091418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e672-9600-4216-924f-5bf5cfa32af4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.091418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693e672-9600-4216-924f-5bf5cfa32af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.125106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0693e672-9600-4216-924f-5bf5cfa32af4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.126520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0693e672-9600-4216-924f-5bf5cfa32af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.138824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 773/1541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.144228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.157222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd388a1-6cf3-45d1-858c-4235341796d1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.167404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.168060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.168336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.168608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.169327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:04.169629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.171328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.172070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d350-c8b6-45f0-b40f-5cd8f44c0fdd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.172349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d350-c8b6-45f0-b40f-5cd8f44c0fdd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.172624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d350-c8b6-45f0-b40f-5cd8f44c0fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.188048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 769/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:04.196566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.196764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-12c1d350-c8b6-45f0-b40f-5cd8f44c0fdd None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.197915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-12c1d350-c8b6-45f0-b40f-5cd8f44c0fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.211583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79aca-3cfb-4692-8593-ec81090440f1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.216397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 774/1543] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:04.222053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.222693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.222973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.223245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.223907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.224942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:04.224942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:20:04.224942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:20:04.226157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df7393-1607-4e4b-a20e-4c324196fa50 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.237398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baefc-2dfb-4767-b337-42570627dcce None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.237682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baefc-2dfb-4767-b337-42570627dcce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.237949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660baefc-2dfb-4767-b337-42570627dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.275886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-660baefc-2dfb-4767-b337-42570627dcce None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.277272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-660baefc-2dfb-4767-b337-42570627dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.292898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 775/1544] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:04.294134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.294481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.294787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.327076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.328373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.343801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 776/1545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.343801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.364923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04b59-ecab-4e6c-bb71-23308a64c08d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.370302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.370966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.371244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.371508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.372805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:04.373151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.374326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:04.374326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:20:04.374326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:20:04.375281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3d416-1bc8-4319-aa34-022e6362cfbc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.381168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 770/1546] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:04.382717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad5915-a1a2-4fd3-baf4-973cd040a520 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.383000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad5915-a1a2-4fd3-baf4-973cd040a520 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.383278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad5915-a1a2-4fd3-baf4-973cd040a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.392380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 777/1547] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:04.393432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f286-6903-4c70-ad5a-40c8586e8793 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.393768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f286-6903-4c70-ad5a-40c8586e8793 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.394201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f286-6903-4c70-ad5a-40c8586e8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.414643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7fc6f286-6903-4c70-ad5a-40c8586e8793 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.416397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7fc6f286-6903-4c70-ad5a-40c8586e8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.417923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-37ad5915-a1a2-4fd3-baf4-973cd040a520 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.419130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-37ad5915-a1a2-4fd3-baf4-973cd040a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.477228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 778/1548] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.478476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.478760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.479034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.487112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 771/1549] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.488695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8136cd-4e80-4489-baa7-df91781b6e80 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.488981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8136cd-4e80-4489-baa7-df91781b6e80 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.489255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8136cd-4e80-4489-baa7-df91781b6e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.500579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.501828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.509018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bc8136cd-4e80-4489-baa7-df91781b6e80 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.509831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 779/1550] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.510620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.510990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bc8136cd-4e80-4489-baa7-df91781b6e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.519547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 772/1551] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.520797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.521080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.521351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.522016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3b30c-8cac-4eae-a54e-6732fde583c8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.526915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.527515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.527849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.528102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.528722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.529737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:04.529737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:20:04.529737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:20:04.530939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9451-f4bc-4505-b740-5a64517fb70f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.540851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.542086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.556316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 773/1552] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.556316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.561358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9512dc7-11f3-4b03-9eca-c1953008566f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.566695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.567292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.567571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.567881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.568495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.570444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.639952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 780/1553] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:04.639952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbcc6-f504-4b10-a68d-d9ed511f179b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.639952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbcc6-f504-4b10-a68d-d9ed511f179b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.639952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bbcc6-f504-4b10-a68d-d9ed511f179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.659438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f03bbcc6-f504-4b10-a68d-d9ed511f179b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.666106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f03bbcc6-f504-4b10-a68d-d9ed511f179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.666240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 774/1554] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:04.666240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.727804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 781/1555] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.729082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd7b9b-8c93-4d2e-a40e-0170879e649e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.729376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd7b9b-8c93-4d2e-a40e-0170879e649e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.729656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd7b9b-8c93-4d2e-a40e-0170879e649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.743565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75aab-6298-4fa3-865d-90e29272c1bf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.748216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.748827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.749105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.749369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.750008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:04.750132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f2bd7b9b-8c93-4d2e-a40e-0170879e649e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.750306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.751222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f2bd7b9b-8c93-4d2e-a40e-0170879e649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.752286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0f912-f0cf-4308-a95c-57cb8fd631e1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.759885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 782/1556] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.761205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b062b2-9383-436c-8377-62ffa12da387 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.761459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b062b2-9383-436c-8377-62ffa12da387 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.761761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b062b2-9383-436c-8377-62ffa12da387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.764012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 775/1557] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:04.765393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.765675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.765940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.783583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-93b062b2-9383-436c-8377-62ffa12da387 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.785201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-93b062b2-9383-436c-8377-62ffa12da387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.786276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.787448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.793396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 783/1558] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.794867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.795144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.795264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 776/1559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.795662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.796015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.800998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:04.806550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d65ff8-0c02-4a83-9962-bd5139ecadd3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.811439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.812061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.812337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.812602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.813232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.814971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.815189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da9d84-da23-42ac-887b-d415020df2ad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.816228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.824064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 784/1560] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.824820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.827983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 777/1561] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:04.827983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.827983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.827983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.838336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870f6c9-fbfa-4157-9a5f-6c3a411ae473 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.842859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.843451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.843788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.848536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.848536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.848536 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.848835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:04.849101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:04.857174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 778/1562] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:04.861221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.868129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060be5b-2904-49b6-b15a-e477b346778c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.872878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.873718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.874262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.874537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.875213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:04.875630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.877288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.889413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 779/1563] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:04.894626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:04.901431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d23d-a8bf-40ba-90a4-8bb39c5b4e48 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:04.906122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:04.906743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:04.907017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:04.907293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:04.908552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:04.910664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:04.983813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:04.989789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 785/1564] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:04.991582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.003523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be68f4-3fed-4c54-8dd9-e0504f9bf89e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.008197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.008973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.009303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.009584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.010225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:05.010521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.012158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.025829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 786/1565] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:05.026754 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.037848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454593cd-28c5-445c-aefd-16003526e87f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.042542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 780/1566] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.043086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.043631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.043894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.044047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.044505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.045242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:05.045763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.047332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.071082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 787/1567] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:05.072262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.084456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49e452-8c88-467f-a654-a9b1f9d3158e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.125984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeeca9-89b8-4b1b-b33a-27123920e4c3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.132362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.132993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.133264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.133545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.134201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:05.134502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.136168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.149392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 781/1568] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:05.150612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.160736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.161360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.161633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.161902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.162559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.164324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.165782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99df6d-de26-446a-9895-0c145f6542f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.170785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.173916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.173916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.173916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.173916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:05.173916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.174866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.176403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 788/1569] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:05.177348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.190600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e1ad-3340-4926-8026-ac93c41b6a6e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.192436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 782/1570] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:05.193126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.201514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.202136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.202409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.202672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.203296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.204778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc210b-91f5-4738-bfad-2197bb3a52a5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.205901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.210065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.210653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.210926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.211548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.211865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.213595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.228585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 783/1571] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:05.229478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.243247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409719d2-8a03-477c-af57-8ad24a5a41dc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.248352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.248994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.249328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.249541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.250798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.253276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.304491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 789/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.305470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.333753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 784/1573] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.334625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.381682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb36ca-6366-468f-a5bb-d0fe2fe99f8d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.403384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:05.408055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de765297-38c6-4cfc-82cc-304b67eaa397 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.413970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.414583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.414855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.415124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.415869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.417799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.438975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:05.446387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.446842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.447117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.447386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.448116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.450105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.526808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 785/1574] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.527625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.557568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 790/1575] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.557568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.569560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd8462-b25d-4cf8-b126-68bca3c8dc1c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.600979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701095d-edb3-47dc-9253-b23da478ca5b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.605794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.606398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.606681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.606976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.607605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.609555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.637274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.637997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.638271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.638539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] PATH_INFO: `/v3/projects/b14abd0da6554b4aa4ce73daadb45d7f/users/83f8f08f77bc4ed49311feab7aa31263/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.653520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14abd0da6554b4aa4ce73daadb45d7f, user_id=83f8f08f77bc4ed49311feab7aa31263, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.656233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.709583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 786/1576] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.710497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.732344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 791/1577] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:05 2022] PUT /identity/v3/projects/b14abd0da6554b4aa4ce73daadb45d7f/users/83f8f08f77bc4ed49311feab7aa31263/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:05.735575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.778186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999a6ae-37af-478a-8e68-f7d3f1cd0707 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.804544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9379a-e0d7-4983-84e1-2521be819fe6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.809397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.810081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.810362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.810635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.811284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.812933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.823394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 792/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:05.824270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.834240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba0256-4807-41e2-9a8b-bccf21d3279d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.839083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.839696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.840019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.840291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.840909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.842876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.845940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.846594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.846898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.847173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.847812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.849708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.953482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 793/1579] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.959968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:05.964251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dfcea-d2a8-412d-8b7d-e1014e58b1a8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:05.968810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:05.969396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:05.969668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:05.969939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:05.971064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:05.973015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:05.989663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:05.999279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 787/1580] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/projects => generated 357 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:05.999279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.053382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 794/1581] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:06.054656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.058511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c362b1-d03c-428e-9ced-f3481c267041 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.063426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.064297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.064674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.064993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.065662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.067588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e803f-0b08-48a8-b860-d3fae4e4e00a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.067851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b088f-d33f-4ac3-a532-b7f4d7986a28 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.072461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.073055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.073329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.073599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.074228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.076260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.086224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 795/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.087034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.097081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f0bb-f64e-48ae-a1e8-296447e3ff13 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.101625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.102206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.102480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.102743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.103393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.105309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.153863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 788/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:05 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:06.155484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.155783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.156063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.175131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:06.178817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:06.180081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:06.180562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 796/1584] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:06 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:06.181548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.188123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 789/1585] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:06.189005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.192385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd018c3-01e9-4280-a9af-c3bf6ea71c90 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.197645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.198307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.198620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.198849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] PATH_INFO: `/v3/projects/60226f5d5db8459ab7380fff204e9f0b/users/a11d8472885c449db11686980171bd22/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.198989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599340-a864-479c-9dd7-e51d16d95182 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.203897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.204233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.204505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.205281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.205916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.207509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.214882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60226f5d5db8459ab7380fff204e9f0b, user_id=a11d8472885c449db11686980171bd22, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.217623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.221547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 790/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.221547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.230266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59441f-b05d-45df-9254-ade2e7a6d79b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.234919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.235524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.235833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.238193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.238193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.238910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.325211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 797/1587] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:06 2022] PUT /identity/v3/projects/60226f5d5db8459ab7380fff204e9f0b/users/a11d8472885c449db11686980171bd22/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:06.326176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.368660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 791/1588] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:06 2022] POST /identity/v3/users => generated 279 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:06.368660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.378422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87eac8-586d-4306-b13e-efeac3d92d3b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.389140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fa7fa-692a-49f5-ab05-4515161ba77c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.403534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.403534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.403534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.403534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.404008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.404008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.407839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 798/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.409421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.423136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694734b-5368-4625-b930-ad684f963326 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.428367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.428870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.429145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.429417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.430055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.431651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.442525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 799/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.442704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.443176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.443297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.443573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.443878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.444526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.446299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.453798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998d214-5141-4b3c-9dc7-0526c04948b6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.459650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.460257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.460558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.460822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.461442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.463039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.463149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 792/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.464016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.475244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 800/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.476096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.485560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2409c-39c7-4c7e-bae0-50c9f28be90b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.491252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.492028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.492300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.492565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.493448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.495036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93243be4-319a-4c69-be5a-84b25171b63a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.505892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 801/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.507084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.507361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.507628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.525830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b3f7b-07af-46a9-9442-80ea910d3b92 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.526538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:06.527731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:06.529477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.530082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.530355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.530619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.536212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 802/1594] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:06.536998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.537285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:06.546439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df130-54ab-45b2-b215-541b8fd181a0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.552303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.552303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.552592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.553032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.553501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.553812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.554508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.556126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.560818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 793/1595] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:06.561736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.569996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 803/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.569996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.574824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32b6c-7d04-4ff0-acb3-b671532ba31c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.577994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3948c8-fea3-4ade-a785-c4c9d734f647 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.581285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.586627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.586627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.586627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.586627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.587003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.587003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.587003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.587234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.587329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.587329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.587329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.594700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 794/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.596159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.601171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 804/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.601171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.606427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f97-14b1-4a9f-a066-4cad4a816865 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.610749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096ddc-76a5-4497-8f41-75df4c112990 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.612299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.613012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.615399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.615399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] PATH_INFO: `/v3/projects/56d58d25666b4b7da1a58ce982fe1fc5/users/bf2cab4aebe54e44aff07c25182b8663/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.616241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.616834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.617108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.617376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.618258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.619876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.628982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d58d25666b4b7da1a58ce982fe1fc5, user_id=bf2cab4aebe54e44aff07c25182b8663, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.630023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:06.630023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:20:06.630023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:20:06.630436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 805/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.631218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.632092 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.640864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35f37f-8f06-471e-ad74-102a99ef5e5d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.645480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.646123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.646478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.646733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] PATH_INFO: `/v3/projects/37d8a0e41eef4ae6b869541fa513e0c7/users/037e346bc69b44919d018e4aee4ae57b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.663607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d8a0e41eef4ae6b869541fa513e0c7, user_id=037e346bc69b44919d018e4aee4ae57b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.666393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.752300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 795/1600] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:06 2022] PUT /identity/v3/projects/56d58d25666b4b7da1a58ce982fe1fc5/users/bf2cab4aebe54e44aff07c25182b8663/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:06.753147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.772190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 806/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:06 2022] PUT /identity/v3/projects/37d8a0e41eef4ae6b869541fa513e0c7/users/037e346bc69b44919d018e4aee4ae57b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:06.773946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.814536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc39d65-3571-4e6d-91a3-e28ae8f2446a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.819087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:06.850767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611de6f2-fbcd-4266-8519-6913a4f1de14 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.855570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.856239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.856541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.856816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.857460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.859064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.867421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.868572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.869241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.869241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.878194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 807/1602] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:06.879277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.882880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.884703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.893029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce3eb1-3aef-4ce4-b8dc-5d5b2bdffcff admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.895966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 796/1603] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:06.897036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:06.901051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.902081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.903141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.903425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] PATH_INFO: `/v3/projects/9347d06864f0454db991834b0edfacb5/users/9713981df78d40dc90422e581022532b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.906610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b182df-8a65-4009-aad7-261384081fb2 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:06.912375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:06.913254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:06.913373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:06.913592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] PATH_INFO: `/v3/projects/f73ae81bf2084be29f992148e830fc2d/users/0a4bb706b2c84c00a4f5eda45a692783/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:06.925576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9347d06864f0454db991834b0edfacb5, user_id=9713981df78d40dc90422e581022532b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.929278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:06.933957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73ae81bf2084be29f992148e830fc2d, user_id=0a4bb706b2c84c00a4f5eda45a692783, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:06.936793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45379-27bb-4c99-8ecf-10bbe8ba9c0a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.037807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 808/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:06 2022] PUT /identity/v3/projects/9347d06864f0454db991834b0edfacb5/users/9713981df78d40dc90422e581022532b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:07.038630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.065366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 797/1605] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:06 2022] PUT /identity/v3/projects/f73ae81bf2084be29f992148e830fc2d/users/0a4bb706b2c84c00a4f5eda45a692783/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:07.070535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815412fd-7278-45d2-9f10-60ed82f47e11 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.076268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815412fd-7278-45d2-9f10-60ed82f47e11 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.076268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815412fd-7278-45d2-9f10-60ed82f47e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.093443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-815412fd-7278-45d2-9f10-60ed82f47e11 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.094731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-815412fd-7278-45d2-9f10-60ed82f47e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.111871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f0b13-a143-4ba5-8c81-a4cba3170b5a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.148759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:07.164091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 798/1606] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.165034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.165320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.165593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.175476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.176223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.176505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.176781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] PATH_INFO: `/v3/projects/79eca2411cf84faba641856de29136cd/users/a23f563b26a84fb7bd7992763f3a891a/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.187964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.189722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.194651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eca2411cf84faba641856de29136cd, user_id=a23f563b26a84fb7bd7992763f3a891a, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.197378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b898-183d-4dfd-961b-6bd84967b5c4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.200651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 799/1607] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.201534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.212060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8c202-59a3-4834-a1ae-1416c7da6a76 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.216815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.217520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.217754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.218031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] PATH_INFO: `/v3/projects/01ab1ef0d9c744278018cc1509e0b728/users/4a532ca532354d4db766cbfeaf3c7169/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.243837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ab1ef0d9c744278018cc1509e0b728, user_id=4a532ca532354d4db766cbfeaf3c7169, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.246658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd814d-4fc0-4d82-b3a9-814a013850ce admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.292839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 809/1608] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:07 2022] PUT /identity/v3/projects/79eca2411cf84faba641856de29136cd/users/a23f563b26a84fb7bd7992763f3a891a/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:07.297683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763d88-7388-4547-b584-a72e320f45ce None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.297683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763d88-7388-4547-b584-a72e320f45ce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.297683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763d88-7388-4547-b584-a72e320f45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.327351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-46763d88-7388-4547-b584-a72e320f45ce None None] MFA Rules not processed for user `9713981df78d40dc90422e581022532b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.328621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-46763d88-7388-4547-b584-a72e320f45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.356111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:07.370665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 800/1609] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:07 2022] PUT /identity/v3/projects/01ab1ef0d9c744278018cc1509e0b728/users/4a532ca532354d4db766cbfeaf3c7169/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:07.372226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.372588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.373246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.408891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] MFA Rules not processed for user `0a4bb706b2c84c00a4f5eda45a692783`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.409558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 810/1610] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.414699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763d88-7388-4547-b584-a72e320f45ce None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.414848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.414969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-46763d88-7388-4547-b584-a72e320f45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.483353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763d88-7388-4547-b584-a72e320f45ce None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.509918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 801/1611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.510967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.562463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.563095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.563659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.564852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.607641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40325aa5-5152-4948-822c-cf8c7d200a89 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.614862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.616288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.616807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.618026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.643113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.644878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8250-2c25-4613-8b26-115350ceed74 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.657586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 811/1612] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:07.660967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.661347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.661622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.694780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] MFA Rules not processed for user `a23f563b26a84fb7bd7992763f3a891a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.696046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.706438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.711089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5928b-38bc-4607-b978-6764fde8185f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.718095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:07.718293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 802/1613] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:07.719636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.719949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.720217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.740045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:07.772276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] MFA Rules not processed for user `4a532ca532354d4db766cbfeaf3c7169`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:07.773477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:07.777496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 812/1614] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.778618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.793567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fbea-c64a-4bf1-8b7e-35b781540374 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.802634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.803312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.803702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.803998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.804721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.808328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edc8c1-6578-465a-9704-6c38aeb1a42a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.868581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 803/1615] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:07.868581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.874541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386f50b-5045-40bf-8d4f-6dc40eeb4566 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:07.879559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:07.880351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.880865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.881103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.881841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:07.883822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:07.956619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 813/1616] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:07.958081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7944eaf-a740-4908-9a80-9ad5b412ca39 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:07.958369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7944eaf-a740-4908-9a80-9ad5b412ca39 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:07.958653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7944eaf-a740-4908-9a80-9ad5b412ca39 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:07.960418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 814/1617] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 18:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:07.961055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7944eaf-a740-4908-9a80-9ad5b412ca39 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:07.990138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 804/1618] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:07.991412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.045813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7944eaf-a740-4908-9a80-9ad5b412ca39 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.063191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d1d78-b72f-4b6e-863b-1906e37aabe6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.068871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.069517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.069734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.070001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.070616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.072651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be2c4-524a-4832-87c0-8fa626e04753 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.117925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.118932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.119270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.119697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.122811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.122811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.174483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 805/1619] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:08.176961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.177319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.177742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.241475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:08.250404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:08.256602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 815/1620] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:07 2022] POST /identity/v3/projects => generated 355 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:08.256602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.318002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:08.358579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb632c5f-a7f1-4da5-9aa9-9b71d10bdcfd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.367887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.368832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.369829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.370255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.371322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.374699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.382941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 806/1621] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:08.398985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.427558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579704d-10ff-4045-a44a-0f1a89d04caa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.434173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.435295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.436016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.436645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.437644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.441688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.461785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 807/1622] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:08.463268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.483935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cd4be-bc29-4d3c-9203-3723e79fcd1c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.490293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.491121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.491555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.491913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.493166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.495615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.505957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 816/1623] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:08 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:08.506772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.528979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:08.536310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35cace-8061-43c3-8092-5584d6116821 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.542697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.543795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.544072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.544339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.617410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.619809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.631420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 808/1624] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:08 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:08.631905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 817/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:08.632905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.641223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.646925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a223-74ab-40f8-92f3-dacac8eaae45 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.656426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12702d24-8250-4636-9eaf-32d558a3c0e2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.657462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.659371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.659940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.660246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] PATH_INFO: `/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3/users/e0ba497212d54e17b6e18917b1a0476e/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.662729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.666502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.666502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.666502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.666502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.667954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.681536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 809/1626] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:08.682701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.690484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2847ea517546dfbc5c6f99b00d9ec3, user_id=e0ba497212d54e17b6e18917b1a0476e, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.699417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.709164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766ca54-5edb-4a60-a8f8-68dea68be2ca admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.715589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.716439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.717064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.717837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.718780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.725919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.739265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 810/1627] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:08.740184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.754322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757977a2-02bd-410d-a0e1-122c8b6be3ab admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:08.760035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:08.764521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:08.764521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:08.764521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] PATH_INFO: `/v3/projects/0b2358509653485d91927ee211301318/users/4b096386ddbb4413a5009cae67289e16/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:08.780643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2358509653485d91927ee211301318, user_id=4b096386ddbb4413a5009cae67289e16, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:08.788919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:08.802630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 818/1628] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:08 2022] PUT /identity/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3/users/e0ba497212d54e17b6e18917b1a0476e/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:08.803610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.894709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 811/1629] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:08 2022] PUT /identity/v3/projects/0b2358509653485d91927ee211301318/users/4b096386ddbb4413a5009cae67289e16/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:08.898534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:08.906624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17900bc6-9c13-46d1-a0ae-bc6966dddd16 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.059534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.060977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.061890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.062545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] PATH_INFO: `/v3/projects/6d9639a6c4054c1fb43273e21142c9cd/users/dba57c31b50040448b5789f5f9f7abfc/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.065549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eae10-5494-4748-af15-b7a72b884ff0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.078102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.079941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.080409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.081813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.083276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.087007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.104550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9639a6c4054c1fb43273e21142c9cd, user_id=dba57c31b50040448b5789f5f9f7abfc, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.112240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.116290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 812/1630] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:09.117484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.131940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe85f7-b6b8-4a59-800e-67893f89bae0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.138943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.139585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.140148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.140470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.141306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.143983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19ec0-7536-49ee-9e9e-ef4f6db77b40 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.158557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 813/1631] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:09.160385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5ae3-87e4-43cb-91b7-e681ac6789ce None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.160746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5ae3-87e4-43cb-91b7-e681ac6789ce None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.161515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5ae3-87e4-43cb-91b7-e681ac6789ce None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.163078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 814/1632] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 18:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:09.163692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5ae3-87e4-43cb-91b7-e681ac6789ce None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.181479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5ae3-87e4-43cb-91b7-e681ac6789ce None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.186562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.187295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.187574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.188113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] PATH_INFO: `/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3/users/e0ba497212d54e17b6e18917b1a0476e/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.204080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 819/1633] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:08 2022] PUT /identity/v3/projects/6d9639a6c4054c1fb43273e21142c9cd/users/dba57c31b50040448b5789f5f9f7abfc/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:09.205788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.207839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2847ea517546dfbc5c6f99b00d9ec3, user_id=e0ba497212d54e17b6e18917b1a0476e, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.216328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddf3b4-a367-400f-b056-0ebb5b1db412 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.242140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 815/1634] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:09 2022] PUT /identity/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3/users/e0ba497212d54e17b6e18917b1a0476e/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:09.244066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855677-ddee-4617-bc66-8c1f7f2b7aa0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.244740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855677-ddee-4617-bc66-8c1f7f2b7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.245180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855677-ddee-4617-bc66-8c1f7f2b7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.280273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4d855677-ddee-4617-bc66-8c1f7f2b7aa0 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:09.284069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4d855677-ddee-4617-bc66-8c1f7f2b7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:09.288646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be90961-e1d3-4b0e-b499-2d220b1cfdb8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.358755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.359300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.359575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.360017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] PATH_INFO: `/v3/projects/0b2358509653485d91927ee211301318/users/4b096386ddbb4413a5009cae67289e16/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.362767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2358509653485d91927ee211301318, user_id=4b096386ddbb4413a5009cae67289e16, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.365971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.388011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 820/1635] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:09 2022] PUT /identity/v3/projects/0b2358509653485d91927ee211301318/users/4b096386ddbb4413a5009cae67289e16/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:09.389764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.452397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 816/1636] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:09.454065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.455900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.456279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.466850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eefd3-2a5e-432b-931b-839dda0e768c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.472502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.473131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.473403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.473668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.474316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.476075 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f101d-0b76-4c27-bae3-ab49ec80b1c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.495418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 821/1637] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:09.499348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.499348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.499348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.524387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] MFA Rules not processed for user `e0ba497212d54e17b6e18917b1a0476e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:09.528053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:09.531367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] MFA Rules not processed for user `4b096386ddbb4413a5009cae67289e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:09.533727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:09.583454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:09.661525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 822/1638] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:09.662362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.668524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 817/1639] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:09.669852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:09.671849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.691165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0b112-fc69-452f-9e13-5c36e30326c4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.705768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.709577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.709577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.709577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] PATH_INFO: `/v3/projects/6d9639a6c4054c1fb43273e21142c9cd/users/dba57c31b50040448b5789f5f9f7abfc/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.709577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9639a6c4054c1fb43273e21142c9cd, user_id=dba57c31b50040448b5789f5f9f7abfc, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:09.719022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:09.745584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 818/1640] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:09 2022] PUT /identity/v3/projects/6d9639a6c4054c1fb43273e21142c9cd/users/dba57c31b50040448b5789f5f9f7abfc/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:09.756659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:09.788320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caed8d4-2b4d-45aa-abbf-2bbbdfc53fd4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.866299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b447b-b55a-4c34-8809-bb41d9d662a9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:09.874094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.874995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.875318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.875640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:09.909100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:09.910349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:09.910349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:09.912686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:10.009519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:10.014287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beac4a-7d5f-4ad9-83ba-2a3d73584ef3 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:10.036985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 819/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:10.038659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:10.044011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:10.044011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:10.079069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:10.081302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:10.082032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] MFA Rules not processed for user `dba57c31b50040448b5789f5f9f7abfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:10.083301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:10.109387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 823/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:10.182458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 820/1643] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:10.189192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:10.199124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41802479-e714-4fa9-9a83-5a72c230641b service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:10.216972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:10.217864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:10.218361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:10.219557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:10.339078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:10.341673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:10.372715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 824/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:10.491568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:10.505824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdacf1-c9c9-4b9f-94d3-65ea00307907 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:10.517781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:10.518673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:10.518856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:10.519122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:10.545034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:10.546867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:10.775504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 821/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:10.959864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:11.045418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:11.289731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:11.304042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c7e57-b083-4a32-8d7c-61f1bb683def service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:11.323038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:11.323848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:11.324187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:11.324517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:11.430143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:11.432688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:11.445983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 825/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:11.651694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:11.665760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f998468-530d-4d3a-b05a-7d57d2781823 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:11.670649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:11.671807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:11.672273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:11.672949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:11.748822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:11.751067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ced333-fdf8-46d9-8d6b-67d49b1d499c service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:11.782536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 822/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:12.160258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:12.274098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:12.294636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcf92-9ef6-49cc-bbf9-4bfad7a7f773 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:12.297250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:12.299485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:12.300217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:12.300634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:12.387824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:12.389856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc28967-150f-4a40-a78b-580fdc030bf5 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:12.414405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 826/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:13.266032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12965c-aee1-4a8e-8b36-9dd4b9553df5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:13.266514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12965c-aee1-4a8e-8b36-9dd4b9553df5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:13.266745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12965c-aee1-4a8e-8b36-9dd4b9553df5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:13.272589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 823/1649] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 18:20:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:13.281196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f645-b2ba-4588-95a8-3a6298e414f0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:13.281970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f645-b2ba-4588-95a8-3a6298e414f0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:13.281970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6f645-b2ba-4588-95a8-3a6298e414f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:13.324346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ebb6f645-b2ba-4588-95a8-3a6298e414f0 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:13.329516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ebb6f645-b2ba-4588-95a8-3a6298e414f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:13.358623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 827/1650] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:13.366372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5482-8bc8-4be9-b505-1cdb72f41bd9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:13.366588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5482-8bc8-4be9-b505-1cdb72f41bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:13.366864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b5482-8bc8-4be9-b505-1cdb72f41bd9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:13.368801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 824/1651] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 18:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:13.377287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:13.377706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:13.378144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:13.418665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:13.422464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:13.451643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 828/1652] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:13.460431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b5482-8bc8-4be9-b505-1cdb72f41bd9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:13.482131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b5482-8bc8-4be9-b505-1cdb72f41bd9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:13.491212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:13.493900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:13.500043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:13.500043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:13.512956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:13.515527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194637-895e-48e4-b4c8-fb1cdf317509 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:13.542885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 825/1653] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:15.107047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:15.115412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:15.365324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce0392-686e-4d22-a77a-c2549d0e71de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:15.380241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:15.381667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:15.382367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:15.383678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] PATH_INFO: `/v3/users/a23f563b26a84fb7bd7992763f3a891a` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:15.397654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23f563b26a84fb7bd7992763f3a891a)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:15.400394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:15.741556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23f563b26a84fb7bd7992763f3a891a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:15.865570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23f563b26a84fb7bd7992763f3a891a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:15.909530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23f563b26a84fb7bd7992763f3a891a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:15.914243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23f563b26a84fb7bd7992763f3a891a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:15.917359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23f563b26a84fb7bd7992763f3a891a'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:15.951025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf257-10ad-4a1b-ab28-79c92db4c8ed None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:15.951635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf257-10ad-4a1b-ab28-79c92db4c8ed None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:15.951635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf257-10ad-4a1b-ab28-79c92db4c8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:15.960242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 829/1654] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:15 2022] DELETE /identity/v3/users/a23f563b26a84fb7bd7992763f3a891a => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:16.019696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d0baf257-10ad-4a1b-ab28-79c92db4c8ed None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:16.026109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d0baf257-10ad-4a1b-ab28-79c92db4c8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:16.103509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:16.167162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 826/1655] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:16.250480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:16.253203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:16.507350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2cf54-c795-4079-b34e-0a15450949f7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:16.520462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:16.524068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:16.524383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:16.535776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:16.585191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:16.586725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97011-9c07-40c8-8698-a7e3563054eb service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:16.614746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 830/1656] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:18.625393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:18.626905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:18.627436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:18.680193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] MFA Rules not processed for user `83f8f08f77bc4ed49311feab7aa31263`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:18.686598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:18.846708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 827/1657] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:18.861539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:18.862142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:18.862487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:18.925051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] MFA Rules not processed for user `83f8f08f77bc4ed49311feab7aa31263`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:18.926787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:18.957201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 831/1658] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:18.977703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:18.979519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:19.069330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:19.071249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:19.116516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cf849-f64c-4b9f-98c9-47ebad9ae596 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:19.142181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:19.143282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:19.143559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:19.144141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] PATH_INFO: `/v3/projects/79eca2411cf84faba641856de29136cd` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:19.147119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eca2411cf84faba641856de29136cd)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:19.148213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: WARNING py.warnings [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:19.148213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: warnings.warn(msg) Aug 24 18:20:19.148213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: Aug 24 18:20:19.153455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:19.163620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b6274-4d3e-4b30-a0a4-5a3bb8681e31 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:19.170390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:19.171123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:19.171506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:19.171882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:19.182696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:19.184607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95856c-1ab7-4c29-a1fb-5b80187f949f service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:19.208988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:19.234738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 828/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:19.386098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eca2411cf84faba641856de29136cd', 'request_id': 'req-c84eac94-4e12-4a37-a606-c513875f3bdf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:19.425977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eca2411cf84faba641856de29136cd', 'request_id': 'req-c84eac94-4e12-4a37-a606-c513875f3bdf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:19.547131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eca2411cf84faba641856de29136cd', 'request_id': 'req-c84eac94-4e12-4a37-a606-c513875f3bdf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:19.565942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] The token cache is being invalidate because project 79eca2411cf84faba641856de29136cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:19.566255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:19.569746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c84eac94-4e12-4a37-a606-c513875f3bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:19.576820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 832/1660] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:19 2022] DELETE /identity/v3/projects/79eca2411cf84faba641856de29136cd => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:19.578677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:19.579098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:19.579564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:19.626425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:19.633565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:19.820526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 829/1661] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:19.823568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:19.823568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:19.823568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:19.862064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:19.863200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:19.886719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 833/1662] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:19.888086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:19.894489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:19.908937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b930-b155-45c5-b12f-430e932d13d6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:19.929428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:19.933942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e34fd-f403-4f9f-9233-b350641cf1ea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:19.968440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 830/1663] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:20:19.973564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:19.983466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69155c1-8999-442e-b6b3-130dffe06acb None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.013265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.014170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.014569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.014963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.015733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.019021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:20.157538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6947-115f-46a8-95c0-011a1c6646db None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.157852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6947-115f-46a8-95c0-011a1c6646db None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.158199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f6947-115f-46a8-95c0-011a1c6646db None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.162004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 831/1664] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 18:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:20.171879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.173083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.175017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.182113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 834/1665] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:19 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:20.199128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:20.328227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:20.330045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:20.428676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8435a-6490-4b9b-abdb-513f8aab5942 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.446030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.449456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.449858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.450562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.457879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.463419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:20.496765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 832/1666] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:20:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:20.575419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:20.576539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 835/1667] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:20 2022] POST /identity/v3/users => generated 303 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:20.582854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:20.591257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:20.618471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726cf9-a26b-4f00-978b-086db3a1bd1d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.621238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d40bb-cbdf-4083-b6bb-7d9b58d096f4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.634471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.635358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.639531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.640081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.640081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.640986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.641409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.641888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.642654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.657592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ef65e-1cfd-49fc-9b0d-145d44952976 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:20.661060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.665447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:20.692090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 833/1668] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:20.706447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 836/1669] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:20.714970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:20.722359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.723356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.723872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.760356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe28b4-84e7-43b3-9fde-76515c6d867a service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.783730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.784425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.784642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.784922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.785553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.787163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:20.817665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] MFA Rules not processed for user `a11d8472885c449db11686980171bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:20.820882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:20.836801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 834/1670] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:20.836801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:20.863151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4cf40-9b4e-49c6-be07-838dc141f96e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:20.889252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:20.889999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:20.890273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:20.890539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] PATH_INFO: `/v3/projects/83304be0fd7945f8a74e28524089ab9c/users/73b5bf71122d4adaa8c5fd1d1ef636db/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:20.936252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83304be0fd7945f8a74e28524089ab9c, user_id=73b5bf71122d4adaa8c5fd1d1ef636db, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:20.940549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89959e2-bf38-4bff-971b-b4891995828a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:21.005902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 837/1671] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:21.007428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:21.009743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:21.041702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 835/1672] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:20 2022] PUT /identity/v3/projects/83304be0fd7945f8a74e28524089ab9c/users/73b5bf71122d4adaa8c5fd1d1ef636db/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:21.044556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:21.044845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:21.045123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:21.089245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:21.091323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:21.193576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 836/1673] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:21.222859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:21.229364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:21.281922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563afb06-451e-41db-8737-f67ddc6a2097 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:21.307462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:21.334809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eeb72-94e1-45ef-a890-a21fdfe1a8e0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:21.342889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:21.343527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:21.343939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:21.344160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:21.363921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:21.368323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355714b-298f-4e8c-93a7-86a17b3dc399 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:21.409013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 837/1674] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:21.428228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:21.480737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:21.482433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:21.482994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:21.483578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:21.561513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:21.575520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efb141-6575-44a3-bf08-945c1cbe8df6 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:21.611697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 838/1675] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:22.397011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dcfd-2f50-4e90-9463-02c1092cc9bd None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:22.398812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dcfd-2f50-4e90-9463-02c1092cc9bd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:22.399251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dcfd-2f50-4e90-9463-02c1092cc9bd None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:22.400897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 838/1676] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 24 18:20:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:20:22.409703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b97dc-0e0a-4557-b172-919c6f32ee56 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:22.410594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b97dc-0e0a-4557-b172-919c6f32ee56 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:22.411038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b97dc-0e0a-4557-b172-919c6f32ee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:22.459718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b69b97dc-0e0a-4557-b172-919c6f32ee56 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:22.461011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b69b97dc-0e0a-4557-b172-919c6f32ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:22.663210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 839/1677] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 24 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:22.672661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dcfd-2f50-4e90-9463-02c1092cc9bd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:22.698559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dcfd-2f50-4e90-9463-02c1092cc9bd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:22.722182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:22.722827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:22.723675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:22.723993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:22.735170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:22.769162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:22.770854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:22.812961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 839/1678] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:24.188529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:24.464224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2320-029c-4efa-9926-d33097831a61 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:24.466188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2320-029c-4efa-9926-d33097831a61 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:24.466188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f2320-029c-4efa-9926-d33097831a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:24.536096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f73f2320-029c-4efa-9926-d33097831a61 None None] MFA Rules not processed for user `bf2cab4aebe54e44aff07c25182b8663`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:24.559216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f73f2320-029c-4efa-9926-d33097831a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:24.755836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 840/1679] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:24.770923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:24.842308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ae88-ec66-468a-9a88-6a029f87732a service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:24.869188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:24.871861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:24.872374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:24.873884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:24.909959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:24.914211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd30f1-6510-4834-b5e1-5feb6ca8ea5d service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:24.978149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 840/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:25.515364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:25.516354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:25.517855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:25.550641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7e7b5-f368-40b1-8f67-4cc627216451 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:25.552310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7e7b5-f368-40b1-8f67-4cc627216451 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:25.552310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7e7b5-f368-40b1-8f67-4cc627216451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:25.575774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] MFA Rules not processed for user `73b5bf71122d4adaa8c5fd1d1ef636db`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:25.577125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:25.654551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7fc7e7b5-f368-40b1-8f67-4cc627216451 None None] MFA Rules not processed for user `037e346bc69b44919d018e4aee4ae57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:25.657484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7fc7e7b5-f368-40b1-8f67-4cc627216451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:25.702472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 841/1681] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:25.707237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:25.721639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25861bd4-5c75-424b-9ace-e89a57919824 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:25.730031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:25.731136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:25.731634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:25.732129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:25.733459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:25.738187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:25.856900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 841/1682] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:25.863729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 842/1683] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:25 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:25.863854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:25.863854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:25.863854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:25.864068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:25.885234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] MFA Rules not processed for user `037e346bc69b44919d018e4aee4ae57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:25.886711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:25.890136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:25.970010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 842/1684] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:25.976633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.086555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fc1e-6925-48a5-ad8d-a16918d17df3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.100127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.100767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.101043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.101310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.101951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.103966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.213284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:26.234091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 843/1685] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:25 2022] POST /identity/v3/users => generated 309 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:26.239740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.272244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494afc-a866-4489-9e11-38ca8fefd574 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.296453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.297087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.297364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.297633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.298888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.304997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaf02f-d4d8-48cd-8051-392320b2d34f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.325417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.329028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.329851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.330249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.333336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.371405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.373768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.385792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 844/1686] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:26.393572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.412329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 843/1687] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:26.439129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e2d82-cf65-4602-97ca-bcec40e7e636 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.456303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.459601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.460508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.460797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] PATH_INFO: `/v3/projects/700f6a89b78d43e8ba2b3d2517524d20/users/090875e6985744278ccd9c25f3a51c5f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.502710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700f6a89b78d43e8ba2b3d2517524d20, user_id=090875e6985744278ccd9c25f3a51c5f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.511209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.540768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.542561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:26.573220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc0800-c32e-4616-9907-2546f1f7732c service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.589843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.590503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.590775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.591041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] PATH_INFO: `/v3/users/0a4bb706b2c84c00a4f5eda45a692783` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.592502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4bb706b2c84c00a4f5eda45a692783)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.593735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 18:20:26.593735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 24 18:20:26.593735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: Aug 24 18:20:26.597896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.666138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 845/1688] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:26 2022] PUT /identity/v3/projects/700f6a89b78d43e8ba2b3d2517524d20/users/090875e6985744278ccd9c25f3a51c5f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:26.670996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.862327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9b88a-1814-4a1a-b98e-a0a1b6a23e64 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.881227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.882223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.883948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.884540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.886742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.889951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.906432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 846/1689] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:26.912063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:26.942047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bbd69-3e6f-4b9c-acc0-37ba2888bd8a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:26.948453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:26.949407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:26.949816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:26.950767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] PATH_INFO: `/v3/projects/700f6a89b78d43e8ba2b3d2517524d20/users/090875e6985744278ccd9c25f3a51c5f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:26.952812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4bb706b2c84c00a4f5eda45a692783'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:26.975051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700f6a89b78d43e8ba2b3d2517524d20, user_id=090875e6985744278ccd9c25f3a51c5f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:26.980288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebdc22-6af8-4e81-ba83-d3ab5c429180 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:26.992657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4bb706b2c84c00a4f5eda45a692783'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:27.006759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 847/1690] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:26 2022] PUT /identity/v3/projects/700f6a89b78d43e8ba2b3d2517524d20/users/090875e6985744278ccd9c25f3a51c5f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:27.074835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4bb706b2c84c00a4f5eda45a692783'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:27.076250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4bb706b2c84c00a4f5eda45a692783'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:27.114952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2c5773a-ea16-4b7e-b172-381e68566209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4bb706b2c84c00a4f5eda45a692783'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:27.130908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac280f6-f87f-4e46-a390-d1cf2b4b23e7 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:27.131207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac280f6-f87f-4e46-a390-d1cf2b4b23e7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:27.131481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac280f6-f87f-4e46-a390-d1cf2b4b23e7 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:27.132886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 848/1691] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 18:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:20:27.138797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 844/1692] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:26 2022] DELETE /identity/v3/users/0a4bb706b2c84c00a4f5eda45a692783 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:27.138964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:27.139316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:27.143500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:27.148304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:27.148796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:27.149437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:27.195108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:27.197286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:27.216688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:27.217960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:27.353372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 849/1693] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:27.377256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:27.379408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:27.379542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 845/1694] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:27.397841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:27.399435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb624-f695-478f-bc9f-8f5e1c6c3119 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:27.409485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:27.410301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:27.410860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:27.411625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:27.424939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:27.425282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06eb01-c2ee-4521-a3a8-7adf9c80f6f8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:27.434553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:27.435241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:27.435468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:27.435731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:27.439209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a20f14-1ad5-4166-bd79-2f45316b56dd service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:27.461065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 850/1695] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:27.464291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:27.466132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1669-d588-4651-8ce5-a3320e3cc615 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:27.474324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:27.506737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 846/1696] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:28.973809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:28.975053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:28.975469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:28.997898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] MFA Rules not processed for user `a11d8472885c449db11686980171bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:28.999342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:29.097676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 851/1697] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:29.372185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1a3d2-15b3-482f-9b80-518b8a5c1e84 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:29.372733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1a3d2-15b3-482f-9b80-518b8a5c1e84 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:29.372906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1a3d2-15b3-482f-9b80-518b8a5c1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:29.403627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:29.405384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:29.436822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283536c-dd1f-434d-8752-7eb21cfac50b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:29.452683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:29.453440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:29.453716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:29.454601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] PATH_INFO: `/v3/projects/f73ae81bf2084be29f992148e830fc2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:29.460101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73ae81bf2084be29f992148e830fc2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:29.465266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:29.543495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ceb1a3d2-15b3-482f-9b80-518b8a5c1e84 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:29.544777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ceb1a3d2-15b3-482f-9b80-518b8a5c1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:29.563735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:29.746015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73ae81bf2084be29f992148e830fc2d', 'request_id': 'req-58ae54a1-0ae3-4da9-bc61-2e26f4394084'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:29.775103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73ae81bf2084be29f992148e830fc2d', 'request_id': 'req-58ae54a1-0ae3-4da9-bc61-2e26f4394084'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:29.824570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 847/1698] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:29.826639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836c7e5-ea7d-418d-8ee1-ca68feadf8cd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:29.827024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836c7e5-ea7d-418d-8ee1-ca68feadf8cd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:29.827371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836c7e5-ea7d-418d-8ee1-ca68feadf8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:29.898543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9836c7e5-ea7d-418d-8ee1-ca68feadf8cd None None] MFA Rules not processed for user `037e346bc69b44919d018e4aee4ae57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:29.907539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9836c7e5-ea7d-418d-8ee1-ca68feadf8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:29.925403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73ae81bf2084be29f992148e830fc2d', 'request_id': 'req-58ae54a1-0ae3-4da9-bc61-2e26f4394084'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:29.945436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] The token cache is being invalidate because project f73ae81bf2084be29f992148e830fc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:29.945769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:29.947116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:29.953515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 852/1699] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:29 2022] DELETE /identity/v3/projects/f73ae81bf2084be29f992148e830fc2d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:29.958742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:29.963103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:30.104111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 848/1700] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:30.179418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:30.180325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:30.180774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:30.190217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae54a1-0ae3-4da9-bc61-2e26f4394084 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:30.198334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:30.199389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:30.199963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:30.200772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] PATH_INFO: `/v3/users/4b096386ddbb4413a5009cae67289e16` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:30.202391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b096386ddbb4413a5009cae67289e16)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:30.205365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:30.224336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:30.278638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] MFA Rules not processed for user `090875e6985744278ccd9c25f3a51c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:30.291567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:30.462097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b096386ddbb4413a5009cae67289e16'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:30.534016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 849/1701] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:30.537797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:30.539583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:30.565377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b096386ddbb4413a5009cae67289e16'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:30.591146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b096386ddbb4413a5009cae67289e16'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:30.591146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b096386ddbb4413a5009cae67289e16'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:30.591146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9b77c44a-275f-42a8-9f5b-5dcfe82b7fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b096386ddbb4413a5009cae67289e16'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:30.625975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 853/1702] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:29 2022] DELETE /identity/v3/users/4b096386ddbb4413a5009cae67289e16 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:30.803846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2c696-729d-4615-83f2-5b7aec8c026e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:31.059630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:31.060806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:31.060806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:31.060806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:31.072809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:31.369313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:31.373036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:31.447505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 850/1703] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 913 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:20:32.306353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:33.342551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043110-8c51-405b-80e9-39eca9847e9d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:33.343551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043110-8c51-405b-80e9-39eca9847e9d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:33.344172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47043110-8c51-405b-80e9-39eca9847e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:33.379566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-47043110-8c51-405b-80e9-39eca9847e9d None None] MFA Rules not processed for user `bf2cab4aebe54e44aff07c25182b8663`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:33.381423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-47043110-8c51-405b-80e9-39eca9847e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:33.505225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:33.508394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:33.878736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 854/1704] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:33.881492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fc524-e092-4593-a988-1dfe428a2bb2 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:33.881492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:33.881492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:33.881492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:33.884513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] PATH_INFO: `/v3/projects/0b2358509653485d91927ee211301318` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:33.884513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2358509653485d91927ee211301318)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:33.884513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:33.884513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:34.324287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2358509653485d91927ee211301318', 'request_id': 'req-1e561253-0614-4219-9f22-255867c04ddd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:34.367361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2358509653485d91927ee211301318', 'request_id': 'req-1e561253-0614-4219-9f22-255867c04ddd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:34.530224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2358509653485d91927ee211301318', 'request_id': 'req-1e561253-0614-4219-9f22-255867c04ddd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:34.545623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] The token cache is being invalidate because project 0b2358509653485d91927ee211301318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:34.545948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:34.546884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e561253-0614-4219-9f22-255867c04ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:34.549303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 851/1705] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:33 2022] DELETE /identity/v3/projects/0b2358509653485d91927ee211301318 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:34.556050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.556631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:34.556631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:34.601900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:34.603619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:34.785272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 855/1706] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:34.795695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6905f3-ba1f-44a7-9741-717766f55268 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.796231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6905f3-ba1f-44a7-9741-717766f55268 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:34.796790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6905f3-ba1f-44a7-9741-717766f55268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:34.842369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-da6905f3-ba1f-44a7-9741-717766f55268 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:34.844064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-da6905f3-ba1f-44a7-9741-717766f55268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:34.863566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 852/1707] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:34.864755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:34.884507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86968f-d556-4642-9e0c-8daf33f59ccf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:34.896072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:34.896785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.897131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:34.901020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:34.901813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:34.902120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:34.903905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:34.943206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 856/1708] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:34.944078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:34.944495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4fc7-be22-4651-8800-630e6e591409 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.945406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4fc7-be22-4651-8800-630e6e591409 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:34.945918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4fc7-be22-4651-8800-630e6e591409 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:34.948136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 853/1709] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:20:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:20:34.971653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.972197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:34.972630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:34.977289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1f89-2aa1-4233-a64a-9186caad38b5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:34.998694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:34.999463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:34.999743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.000036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.002145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:35.005313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:35.020311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:35.033104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:35.155957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 857/1710] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:34 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:35.160241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:35.174342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:35.254079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 854/1711] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:20:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:35.390549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e53f0-c73a-4a77-8c38-7e13790dc40a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:35.403310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:35.404732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.406062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.407023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.414410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:35.430893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:35.566956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 858/1712] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:35 2022] POST /identity/v3/users => generated 282 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:35.571408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:35.595435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634d4e2-015b-4467-816f-5e66047da1d0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:35.609289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:35.614371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.614865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.615444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.616329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:35.623934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4779-4f0b-4ecf-b693-54bec4fc126a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:35.643720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 855/1713] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:35.648880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:35.662844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.663822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.664988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.669250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b561807-1fa4-44a8-b292-5c37ad17ed2a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:35.679271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:35.680003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.680790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.686003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.686003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:35.686452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:35.716777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:35.723470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:35.723731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 859/1714] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:35.728797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:35.754095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eec69-3a3d-451d-9d22-7be21a9e8bb8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:35.773020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:35.774103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.774593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.775066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] PATH_INFO: `/v3/projects/81cc7f6d34794c60a2e06ea99bf427f9/users/2cebb691177f43f4980bb0f7131e197c/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:35.829858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cc7f6d34794c60a2e06ea99bf427f9, user_id=2cebb691177f43f4980bb0f7131e197c, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:35.838201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487e9e-d6b5-49f2-918c-0b35c83ae370 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:35.900186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 856/1715] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Aug 24 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:35.957868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 860/1716] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:35 2022] PUT /identity/v3/projects/81cc7f6d34794c60a2e06ea99bf427f9/users/2cebb691177f43f4980bb0f7131e197c/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:35.958413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:35.973478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:35.973609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:35.973609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:35.973787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:36.017707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:36.066298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] MFA Rules not processed for user `2cebb691177f43f4980bb0f7131e197c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:36.068585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:36.192736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df475c-a1e0-4407-a6b8-cc376562d59c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:36.317158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 861/1717] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:36.326476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:36.514320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:36.515416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:36.518668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:36.520702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:36.553787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:36.559626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:36.591618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 857/1718] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:36.592741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:36.599939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:36.605776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20fe16-c8a5-473c-98b2-66ba1d443efd None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:36.634117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:36.635157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:36.635607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:36.636462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:36.637610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:36.641199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:36.802385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 862/1719] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:36 2022] POST /identity/v3/projects => generated 365 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:36.809478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:36.887192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96a792-c58d-4e43-a09f-001ae9785f9c service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.020197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956cf2-bbc3-418d-9679-d157837ac310 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.050340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.052525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.052812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.054349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.054349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.067016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:37.069500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.083619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.083619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.083619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.119447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.121613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:37.157035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 858/1720] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:37.291094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:37.294066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 863/1721] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:36 2022] POST /identity/v3/users => generated 289 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:37.318398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5866-ea05-4c1d-a97e-8fc6d9e0ce9a service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.347982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.348975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.362216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.365239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.365239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.371988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:37.379443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:37.423412 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 859/1722] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:37.423513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:37.445212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42323b52-3131-4eb7-a355-88055ead5027 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.451960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.460672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.461052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.461321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] PATH_INFO: `/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5/users/d0477e4296c84421bc87630fde253035/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.511499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b55f72bb9e4ae484fd2c8dd15785d5, user_id=d0477e4296c84421bc87630fde253035, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.517827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:37.635396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 864/1723] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:37 2022] PUT /identity/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5/users/d0477e4296c84421bc87630fde253035/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:37.643409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:37.659925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025234b-a54f-499a-a46e-196c91d04c8f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.872378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.873081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.873418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.873697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.874561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.877450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44ed9d-bc91-4c98-861c-0f95e00b359a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:37.904721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 860/1724] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:37.907387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:37.930982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df2996-9177-4fc4-8371-f1beb7d90180 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:37.960837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:37.965884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:37.976706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:37.977700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] PATH_INFO: `/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5/users/d0477e4296c84421bc87630fde253035/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:37.984090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b55f72bb9e4ae484fd2c8dd15785d5, user_id=d0477e4296c84421bc87630fde253035, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:37.992772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:38.040065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 865/1725] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:37 2022] PUT /identity/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5/users/d0477e4296c84421bc87630fde253035/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:38.045393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:38.053468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:38.054245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:38.075394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:38.133381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] MFA Rules not processed for user `d0477e4296c84421bc87630fde253035`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:38.142145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:38.423875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 861/1726] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:38.438050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:38.440807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:38.618837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde63b3-816f-41d0-ab8b-9fc41bf33d15 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:38.624364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:38.625109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:38.625516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:38.626559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:38.661940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:38.664189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:38.691340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 866/1727] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:39.258272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:39.295954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885e409-d14f-40a3-b84f-5eff3a0fc975 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:39.326003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:39.326003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:39.326003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:39.326003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:39.667513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:39.670153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71519b7b-08de-4199-8fa7-63458ba67493 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:39.700745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 862/1728] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:40.042713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:40.053641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:40.278237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:40.429524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840c64-4ec6-49c8-b0d8-baa27ac7d710 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:40.483739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:40.489045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:40.493006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:40.497476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] PATH_INFO: `/v3/users/73b5bf71122d4adaa8c5fd1d1ef636db` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:40.502431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b5bf71122d4adaa8c5fd1d1ef636db)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:40.521855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:40.988121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b5bf71122d4adaa8c5fd1d1ef636db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:41.076354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b5bf71122d4adaa8c5fd1d1ef636db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:41.117182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b5bf71122d4adaa8c5fd1d1ef636db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:41.119914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b5bf71122d4adaa8c5fd1d1ef636db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:41.129984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7ad15a05-f4d6-467c-812c-30edb87e2dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b5bf71122d4adaa8c5fd1d1ef636db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:41.177018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 867/1729] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:40 2022] DELETE /identity/v3/users/73b5bf71122d4adaa8c5fd1d1ef636db => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:41.949819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:41.951788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:41.952308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:41.962781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 863/1730] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:20:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:20:41.998208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:41.998981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:41.999540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:42.070324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:42.073726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:42.230258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 868/1731] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:42.364475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:42.367356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:42.416301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463946b-754b-4dfa-94de-6f94e7f1e043 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:42.431298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:42.432507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:42.433325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:42.433810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:42.458985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:42.460558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:42.513226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 864/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:43.066605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:43.069155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:43.239331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:43.310961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcde40-b0ad-4624-9f3f-9638b456246a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:43.325329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:43.327110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:43.327989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:43.329428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] PATH_INFO: `/v3/projects/83304be0fd7945f8a74e28524089ab9c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:43.332462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83304be0fd7945f8a74e28524089ab9c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:43.335168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:43.548657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83304be0fd7945f8a74e28524089ab9c', 'request_id': 'req-ff05ea94-6240-4d15-a131-575578cb3525'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:43.557310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83304be0fd7945f8a74e28524089ab9c', 'request_id': 'req-ff05ea94-6240-4d15-a131-575578cb3525'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:43.636181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83304be0fd7945f8a74e28524089ab9c', 'request_id': 'req-ff05ea94-6240-4d15-a131-575578cb3525'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:43.659913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] The token cache is being invalidate because project 83304be0fd7945f8a74e28524089ab9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:43.660253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:43.662404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:43.677344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 869/1733] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:43 2022] DELETE /identity/v3/projects/83304be0fd7945f8a74e28524089ab9c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:43.682266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:43.691038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:43.702780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ccabb-a115-44c0-9077-21085cb06c6d service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:43.876342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:43.877518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:43.877868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:43.879064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] PATH_INFO: `/v3/users/090875e6985744278ccd9c25f3a51c5f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:43.879902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090875e6985744278ccd9c25f3a51c5f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:43.883285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:43.925254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:43.926906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:43.966494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ea94-6240-4d15-a131-575578cb3525 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:43.984068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:43.990175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:43.990723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:43.991098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] PATH_INFO: `/v3/users/4a532ca532354d4db766cbfeaf3c7169` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:43.995802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a532ca532354d4db766cbfeaf3c7169)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:43.999672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:44.248493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090875e6985744278ccd9c25f3a51c5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.271639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090875e6985744278ccd9c25f3a51c5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.347197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a532ca532354d4db766cbfeaf3c7169'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.366953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090875e6985744278ccd9c25f3a51c5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.367894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090875e6985744278ccd9c25f3a51c5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.430868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c0eeeaed-567a-4ec5-b8dc-9efcdae0eac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090875e6985744278ccd9c25f3a51c5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.446004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 865/1734] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:43 2022] DELETE /identity/v3/users/090875e6985744278ccd9c25f3a51c5f => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:44.488222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a532ca532354d4db766cbfeaf3c7169'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.508021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a532ca532354d4db766cbfeaf3c7169'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.509454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a532ca532354d4db766cbfeaf3c7169'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.510219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a532ca532354d4db766cbfeaf3c7169'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:44.528813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 870/1735] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:43 2022] DELETE /identity/v3/users/4a532ca532354d4db766cbfeaf3c7169 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:44.530183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:44.530466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:44.530832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:44.574296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:44.579914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:44.751876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 866/1736] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:44.761149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:44.762844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:44.835202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:44.875175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491b67e-f49f-46b6-9e00-d4019066b51f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:44.891384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:44.895211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:44.895500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:44.895792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:44.917968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:44.919960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:44.955015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 871/1737] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:45.100832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:45.102658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:45.129092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:45.133539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:45.138546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ff13e-0b1a-4f28-9d0d-0f44e7480d34 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:45.156126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:45.157428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:45.157807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:45.158176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] PATH_INFO: `/v3/users/2cebb691177f43f4980bb0f7131e197c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:45.159804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cebb691177f43f4980bb0f7131e197c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:45.161315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455214-529f-46e9-ab00-953303af29a7 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:45.162323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:45.176664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:45.180980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:45.181474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:45.182440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] PATH_INFO: `/v3/projects/700f6a89b78d43e8ba2b3d2517524d20` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:45.184638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700f6a89b78d43e8ba2b3d2517524d20)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:45.187020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:45.230489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:45.453269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cebb691177f43f4980bb0f7131e197c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.466022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700f6a89b78d43e8ba2b3d2517524d20', 'request_id': 'req-8da2208e-6507-4245-8673-52cbe80d95f4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.476398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cebb691177f43f4980bb0f7131e197c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.492635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700f6a89b78d43e8ba2b3d2517524d20', 'request_id': 'req-8da2208e-6507-4245-8673-52cbe80d95f4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.581962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cebb691177f43f4980bb0f7131e197c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.583146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cebb691177f43f4980bb0f7131e197c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.642283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700f6a89b78d43e8ba2b3d2517524d20', 'request_id': 'req-8da2208e-6507-4245-8673-52cbe80d95f4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.645012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fa2ee4e-9dec-4990-b974-0be74f75e2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cebb691177f43f4980bb0f7131e197c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.666800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 867/1738] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:45 2022] DELETE /identity/v3/users/2cebb691177f43f4980bb0f7131e197c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:45.673620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:45.674034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:45.674690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:45.714437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] The token cache is being invalidate because project 700f6a89b78d43e8ba2b3d2517524d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:45.714733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.715541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8da2208e-6507-4245-8673-52cbe80d95f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:45.722184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 872/1739] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:45 2022] DELETE /identity/v3/projects/700f6a89b78d43e8ba2b3d2517524d20 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:45.724811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44b18-d6dc-42a8-bcc6-d678a8d7c145 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:45.725272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44b18-d6dc-42a8-bcc6-d678a8d7c145 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:45.725779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44b18-d6dc-42a8-bcc6-d678a8d7c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:45.762990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:45.784910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:45.791222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3ed44b18-d6dc-42a8-bcc6-d678a8d7c145 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:45.804867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3ed44b18-d6dc-42a8-bcc6-d678a8d7c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:46.013832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 873/1740] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:46.021926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.022983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.028086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.058839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 868/1741] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:46.080855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:46.080855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:46.091728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 874/1742] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:46.097844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.110226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415194d-300c-4590-85f6-92ff7c0ac357 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.119598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.122734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.126712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.126712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.126712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:46.126712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.127874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.160094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 869/1743] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:46.171235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.224405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.226273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:46.236512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ef298-fc8b-4a5d-b4cb-65c8a871df3c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.246753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.247881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.248497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.256385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.257902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.264778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.352411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83c8b4-ffb2-44d9-a69f-6dbbb4f65a01 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.370708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.371558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.371879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.372160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.404140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.405859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.429716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 875/1744] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:46 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:46.435418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.440972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 870/1745] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:46.615164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:46.650208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37227ea7-6a01-4c05-81a4-ab3ff2683eb1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.658012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.659092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.659688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.660089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.660738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.662734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.761192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 876/1746] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:46 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:46.765038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.784051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549ae5c-dc61-4bb8-a19f-6b51d6d1bcbc service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.790197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.790857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.791223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.791415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.792379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.794097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.811795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 871/1747] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:46.820398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.844769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26561fd-c695-4531-beba-459909851cd0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.873712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.875199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.878756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.878756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.878756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.878756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ca0de-d265-4575-ba96-29d6740355b5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:46.897150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 877/1748] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:46.897949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:46.921722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885edd-2492-4fa9-80c9-768e3d3b07a0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:46.935708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:46.936714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:46.937166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:46.937611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] PATH_INFO: `/v3/projects/a95bf87e43e84c5ca404826c70219e77/users/e8840533b186459dbd08738dfc956de1/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:46.971612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:46.978612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95bf87e43e84c5ca404826c70219e77, user_id=e8840533b186459dbd08738dfc956de1, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:46.983204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:47.101226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 872/1749] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:46 2022] PUT /identity/v3/projects/a95bf87e43e84c5ca404826c70219e77/users/e8840533b186459dbd08738dfc956de1/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:47.102974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:47.103798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:47.104424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:47.145267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] MFA Rules not processed for user `e8840533b186459dbd08738dfc956de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:47.147798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:47.317105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 878/1750] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:47.329916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:47.472075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ac4d-84b9-4108-9073-f20fd418b999 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:47.500112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:47.501292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:47.501738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:47.502179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:47.502691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:47.505498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:47.719788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 873/1751] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:47 2022] POST /identity/v3/projects => generated 365 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:47.728535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:47.752472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3814-cc09-4379-adc2-3b42dc1371f3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:47.846938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:47.847916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:47.848333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:47.848863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:47.849775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:47.852549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.001004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.001004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:48.024347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1226-6c2a-4af7-bb57-0994e12bb589 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.043088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.050600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.050600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.050600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] PATH_INFO: `/v3/projects/01ab1ef0d9c744278018cc1509e0b728` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.050600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ab1ef0d9c744278018cc1509e0b728)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.051210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.093287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 879/1752] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:47 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:48.113439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.130618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478ce0-c2db-4a0e-95f3-a9c6d7c83c0c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.146813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.147453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.147733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.148027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.148679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.150344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.174600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 880/1753] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:48.179090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.199728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eabd7-9db5-490a-8f22-f39b5541a20a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.207145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ab1ef0d9c744278018cc1509e0b728', 'request_id': 'req-3f673aa2-3f52-45ab-bbad-907bd6d2b003'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.215490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ab1ef0d9c744278018cc1509e0b728', 'request_id': 'req-3f673aa2-3f52-45ab-bbad-907bd6d2b003'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.239420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:48.301327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.302499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.302499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.302696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] PATH_INFO: `/v3/projects/7d625f4bf12b459dbd2182746aff1135/users/bf8e3e49983c44169def21be428928aa/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.319464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d625f4bf12b459dbd2182746aff1135, user_id=bf8e3e49983c44169def21be428928aa, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.322888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.370481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ab1ef0d9c744278018cc1509e0b728', 'request_id': 'req-3f673aa2-3f52-45ab-bbad-907bd6d2b003'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.382508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] The token cache is being invalidate because project 01ab1ef0d9c744278018cc1509e0b728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:48.386299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.386299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.386299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 874/1754] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:47 2022] DELETE /identity/v3/projects/01ab1ef0d9c744278018cc1509e0b728 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:48.389016 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.390465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:48.404470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673aa2-3f52-45ab-bbad-907bd6d2b003 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.411139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.412243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.412681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.413066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] PATH_INFO: `/v3/users/dba57c31b50040448b5789f5f9f7abfc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.414777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba57c31b50040448b5789f5f9f7abfc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.417056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.464270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 881/1755] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:48 2022] PUT /identity/v3/projects/7d625f4bf12b459dbd2182746aff1135/users/bf8e3e49983c44169def21be428928aa/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:48.468820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.470917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:48.561587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2ed8-11ee-445f-be68-c9ac478bc454 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.580264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.581015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.581413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.581800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.582516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.584254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.597714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 882/1756] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:48.600207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.619578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e38d5-633c-4abc-97e2-8d84645a50e1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.626476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.627554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.628034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.629090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] PATH_INFO: `/v3/projects/7d625f4bf12b459dbd2182746aff1135/users/bf8e3e49983c44169def21be428928aa/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.631595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d625f4bf12b459dbd2182746aff1135, user_id=bf8e3e49983c44169def21be428928aa, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.634742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d585c0b-11a7-4155-b5e4-2f3114073ba1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:48.649487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 883/1757] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:48 2022] PUT /identity/v3/projects/7d625f4bf12b459dbd2182746aff1135/users/bf8e3e49983c44169def21be428928aa/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:48.665181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.665181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.665181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.697919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] MFA Rules not processed for user `bf8e3e49983c44169def21be428928aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:48.699129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:48.800053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 884/1758] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:48.808313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:48.808313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:48.824015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba57c31b50040448b5789f5f9f7abfc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.830390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:48.833324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba57c31b50040448b5789f5f9f7abfc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:48.892920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0144caf-d5ed-43b4-8e62-c5ed03f3fe70 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:48.899042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:48.899800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:48.900178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:48.900458 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] PATH_INFO: `/v3/projects/81cc7f6d34794c60a2e06ea99bf427f9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:48.901872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cc7f6d34794c60a2e06ea99bf427f9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:48.904251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:49.004537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba57c31b50040448b5789f5f9f7abfc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.005210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba57c31b50040448b5789f5f9f7abfc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.019387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba57c31b50040448b5789f5f9f7abfc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.025588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 875/1759] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:48 2022] DELETE /identity/v3/users/dba57c31b50040448b5789f5f9f7abfc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:49.026483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:49.027893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:49.111214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cc7f6d34794c60a2e06ea99bf427f9', 'request_id': 'req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.121484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cc7f6d34794c60a2e06ea99bf427f9', 'request_id': 'req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.143327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10626-c527-4acf-8687-848c11c61a7b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:49.198192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:49.198818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:49.199093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:49.199362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:49.201224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:49.236790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cc7f6d34794c60a2e06ea99bf427f9', 'request_id': 'req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.256222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] The token cache is being invalidate because project 81cc7f6d34794c60a2e06ea99bf427f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:49.256867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.257766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-000661d3-7ed4-4e01-a3b3-9884cdc38f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:49.266902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 885/1760] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:48 2022] DELETE /identity/v3/projects/81cc7f6d34794c60a2e06ea99bf427f9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:49.266902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:49.266902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:49.266902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:49.266902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 886/1761] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:49.268565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:49.270729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:49.304509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:49.306173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a007-3704-473c-9488-50203eef4700 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:49.330669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 876/1762] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:49.344880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:49.345964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:49.346456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:49.348146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f888366-31a5-4b10-b277-e123b2dd4d59 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:49.355897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:49.360984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:49.360984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:49.360984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] PATH_INFO: `/v3/users/d0477e4296c84421bc87630fde253035` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:49.360984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0477e4296c84421bc87630fde253035)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:49.361412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:49.379207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:49.381389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:49.472123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 877/1763] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:49.488032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:49.490201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:49.507088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21cc44-2671-40c7-a4a1-d95626b0a64e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:49.513899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:49.514705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:49.515121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:49.515488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:49.527487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:49.529329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:49.554106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 878/1764] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:51.022981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:51.025200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.055424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0477e4296c84421bc87630fde253035'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.056282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67787127-50c6-48f2-b203-4e3fee5d2939 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:51.069728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:51.071890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.072337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.072879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] PATH_INFO: `/v3/projects/6d9639a6c4054c1fb43273e21142c9cd` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.084810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9639a6c4054c1fb43273e21142c9cd)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:51.087581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:51.143020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:51.158070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0477e4296c84421bc87630fde253035'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.168442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0477e4296c84421bc87630fde253035'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.169130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0477e4296c84421bc87630fde253035'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.169731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0477e4296c84421bc87630fde253035'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.183188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 887/1765] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:49 2022] DELETE /identity/v3/users/d0477e4296c84421bc87630fde253035 => generated 0 bytes in 1915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:51.186413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:51.186413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.268428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad7b1f-5be9-48bd-811c-f12c3ecc14a1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:51.274397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:51.275357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.275893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.276373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.279375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.365246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:51.366705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dfbe6-5d38-4ba3-9dcd-674c7a441a30 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:51.377181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 888/1766] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:51.401059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9639a6c4054c1fb43273e21142c9cd', 'request_id': 'req-77de2e1e-7b62-4cf5-9445-ac23bb08af28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.410911 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9639a6c4054c1fb43273e21142c9cd', 'request_id': 'req-77de2e1e-7b62-4cf5-9445-ac23bb08af28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.531031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9639a6c4054c1fb43273e21142c9cd', 'request_id': 'req-77de2e1e-7b62-4cf5-9445-ac23bb08af28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.547690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] The token cache is being invalidate because project 6d9639a6c4054c1fb43273e21142c9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:51.548097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.548788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-77de2e1e-7b62-4cf5-9445-ac23bb08af28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.554120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 879/1767] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:51 2022] DELETE /identity/v3/projects/6d9639a6c4054c1fb43273e21142c9cd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:51.555871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.556162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.556433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.582680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:51.584625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.655503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 889/1768] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:51.664162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.664519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.664821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.684993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:51.686218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.694988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 880/1769] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:51.699446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:51.723827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b5af9-c7ff-4af6-9312-f716f144abc9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:51.723827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:51.724409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.724852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.725319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.726155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:51.726623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:51.728615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:51.730588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:51.732285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:51.753121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387ae8b-8207-481f-b147-27b8831a1717 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:51.762228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:51.763840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.765106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.765106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] PATH_INFO: `/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.767797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 890/1770] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:20:51.772665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b55f72bb9e4ae484fd2c8dd15785d5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:51.773247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:51.775254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:51.792924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed5cd-244b-4398-8c5a-1bfb322a236e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:51.799103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:51.799735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:51.800041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:51.800310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:51.800985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:51.803067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:51.932103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b55f72bb9e4ae484fd2c8dd15785d5', 'request_id': 'req-f0e80dc0-68f6-4300-9492-4fc0873974ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.939097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b55f72bb9e4ae484fd2c8dd15785d5', 'request_id': 'req-f0e80dc0-68f6-4300-9492-4fc0873974ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:51.953713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 891/1771] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:51 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:51.958322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.036258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412af3d-9a07-4912-9bdc-f8d064a1d841 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.042081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.042701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.042978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.043249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.043917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.045990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.090410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b55f72bb9e4ae484fd2c8dd15785d5', 'request_id': 'req-f0e80dc0-68f6-4300-9492-4fc0873974ee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:52.106513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] The token cache is being invalidate because project 44b55f72bb9e4ae484fd2c8dd15785d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:52.107376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:52.108140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f0e80dc0-68f6-4300-9492-4fc0873974ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:52.110618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 881/1772] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:51 2022] DELETE /identity/v3/projects/44b55f72bb9e4ae484fd2c8dd15785d5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:52.116941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c97ee-9baf-4a77-84c7-3f6d48b365e5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.117712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c97ee-9baf-4a77-84c7-3f6d48b365e5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.118697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c97ee-9baf-4a77-84c7-3f6d48b365e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.140370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-947c97ee-9baf-4a77-84c7-3f6d48b365e5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:52.141774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-947c97ee-9baf-4a77-84c7-3f6d48b365e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:52.150237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 882/1773] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:52.165393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.165630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.165903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.194828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:52.196078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:52.202087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 892/1774] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:51 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:52.204354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.206012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:52.223291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52459b9b-483b-4927-bb2f-17d06b012463 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.223528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 883/1775] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:52.225087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.230179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.230943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.231369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.232590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.233479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.235788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.242857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297737-d4a4-4f12-88c2-e706a67fe155 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.248853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.249632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.249907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.250895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.251863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:52.252266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.255152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.256424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 893/1776] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:52.258371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.270465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e239a-544f-4bee-ae06-7c549f6e9c2f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.274952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 884/1777] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:52.275360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.276042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.276324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.276590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.277330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.277445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.279303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.291475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194d95d-9071-4ee9-b20a-e1d1ab1d866e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.294675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 894/1778] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:52.298296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.299071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.299339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.299445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.299866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.300487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.302619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60dfc7-1b32-4563-9cbc-81030202345e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.309818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824fd1-020a-4520-a81e-05d63c15a77c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.316955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.318011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.318476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.319058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] PATH_INFO: `/v3/projects/11d7f42f91ef405c8df8f7ba5e1a3325/users/8742268b96e849bdb42ea0fa28c1a544/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.339592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d7f42f91ef405c8df8f7ba5e1a3325, user_id=8742268b96e849bdb42ea0fa28c1a544, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.342541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.456931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 895/1779] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:52 2022] PUT /identity/v3/projects/11d7f42f91ef405c8df8f7ba5e1a3325/users/8742268b96e849bdb42ea0fa28c1a544/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:52.457110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 885/1780] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:52.457203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.458899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.459184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.459484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.488052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] MFA Rules not processed for user `8742268b96e849bdb42ea0fa28c1a544`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:52.489252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:52.525300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1b91-92a2-4617-b4cd-e4d218d63ce8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.558173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 886/1781] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:52.563254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.591317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.598595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.598595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.598595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.599003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.600921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.632426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eda3f-ad22-4f18-8723-797111209e2c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.637148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.637759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.638037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.638307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.638930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.641523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.692053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 896/1782] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:52.696030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.705819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4807ee-50a0-4a33-a004-8dfd2b834fbd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.714602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.714602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.714602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.714602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.715022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.715022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.724447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 897/1783] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:52.728544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.738887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4413e-33ea-453f-a533-95981529b523 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.743822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.750676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.750676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.750676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.750676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.750676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.758427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 898/1784] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:52.762728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.772909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9d32d-d4ba-4d60-83bc-cbd7eb75b5bd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.778374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.779031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.779303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.779615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] PATH_INFO: `/v3/projects/f8c955c989074830b3fbae27c544e359/users/b90343c5ce5244698365908848916e4a/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.782228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 887/1785] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:52.787201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:52.810481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c955c989074830b3fbae27c544e359, user_id=b90343c5ce5244698365908848916e4a, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.817886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28931c-df6b-4540-a488-b557c40452b9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.879580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b873a3-916a-438f-bc88-ac812a486516 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:52.886513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:52.887208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.887453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.887725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.888631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:52.890990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:52.937149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 899/1786] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:52 2022] PUT /identity/v3/projects/f8c955c989074830b3fbae27c544e359/users/b90343c5ce5244698365908848916e4a/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:52.949460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:52.949818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:52.950157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:52.988798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] MFA Rules not processed for user `b90343c5ce5244698365908848916e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:52.990314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:53.014567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 888/1787] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:53.020692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.044365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736fd0-26a4-462e-b94d-1938cb56c902 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.105084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 900/1788] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:53.111622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.153979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.154590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.154864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.155130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.155780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.157968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.168653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 889/1789] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:53.173559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.183630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcafb49-548e-4213-aa10-96a47fc7713c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.184260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75ab6e-97b6-4d6e-a168-e1b5b551a836 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.188607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.189432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.193510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.193510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.193510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.193780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.193780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.193780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.194013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.194102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] PATH_INFO: `/v3/projects/983b063a8d354d7182a9a651278744a2/users/8d761f10b03e4329b879d39c536dab41/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.212386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983b063a8d354d7182a9a651278744a2, user_id=8d761f10b03e4329b879d39c536dab41, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.215117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.282149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 901/1790] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:53 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:53.283779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.342136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 890/1791] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:53 2022] PUT /identity/v3/projects/983b063a8d354d7182a9a651278744a2/users/8d761f10b03e4329b879d39c536dab41/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:53.346895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.348553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d779-6312-4930-9507-e41265072a8f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.428189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.428862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.429808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.429808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.430146 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.435240 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.436167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4757caa-95bc-4313-88f9-894db5f68eb5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.442827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.443570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.443938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.444271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.444980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.446662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.459045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 891/1792] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:53.461901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:53.469761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.480465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2048c-2f59-4418-a857-785f1f5e19a5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.488622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.488622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.488622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.488622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] PATH_INFO: `/v3/projects/983b063a8d354d7182a9a651278744a2/users/8d761f10b03e4329b879d39c536dab41/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.488963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983b063a8d354d7182a9a651278744a2, user_id=8d761f10b03e4329b879d39c536dab41, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.491148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35a2c5-d251-4b1e-adfd-f0453086a0a2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.503346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 892/1793] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:53 2022] PUT /identity/v3/projects/983b063a8d354d7182a9a651278744a2/users/8d761f10b03e4329b879d39c536dab41/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:53.516562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.516897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.517171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.554182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] MFA Rules not processed for user `8d761f10b03e4329b879d39c536dab41`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:53.555970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:53.577356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 902/1794] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:53 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:20:53.582704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.593519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e4164-7ede-4567-9d32-2e263d6cb9a6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.643326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 893/1795] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:20:53.657249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.658874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:53.662171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.664454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.664454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.664454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.664454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.670721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.679668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 903/1796] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:20:53.684122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.693775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:53.701762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c72e0-102b-4542-9c40-7660cbab45e4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.710358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.711149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.711495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.711868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] PATH_INFO: `/v3/projects/50b8460076c74b48b3d24936660c2478/users/5f3f2766f55a4f4d89f058ed79ef4149/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.729401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b8460076c74b48b3d24936660c2478, user_id=5f3f2766f55a4f4d89f058ed79ef4149, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.732289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.733871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bd19-dfbc-44a2-902a-791ced354b29 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.737787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.738405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.738734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.738957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.798373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.799896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.809488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 894/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:53.839116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 904/1798] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:53 2022] PUT /identity/v3/projects/50b8460076c74b48b3d24936660c2478/users/5f3f2766f55a4f4d89f058ed79ef4149/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:20:53.851839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:53.869488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d802fa-0c3e-48d7-8a1a-3c73bbe1127f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:53.964439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:53.965362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:53.965622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:53.966111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:53.966944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:53.969308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584e356-abf8-477c-99f2-99716fe500ca admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:53.982923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 895/1799] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:53.999220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:54.014485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea418-6f37-42d4-8f53-e86c3fe75cbd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:54.020932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:54.021669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:54.021952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:54.022224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] PATH_INFO: `/v3/projects/50b8460076c74b48b3d24936660c2478/users/5f3f2766f55a4f4d89f058ed79ef4149/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:54.036673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b8460076c74b48b3d24936660c2478, user_id=5f3f2766f55a4f4d89f058ed79ef4149, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:54.042246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:54.079787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 905/1800] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:53 2022] PUT /identity/v3/projects/50b8460076c74b48b3d24936660c2478/users/5f3f2766f55a4f4d89f058ed79ef4149/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:54.100557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:54.100557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:54.100557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:54.146048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] MFA Rules not processed for user `5f3f2766f55a4f4d89f058ed79ef4149`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:54.147246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:54.246185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 896/1801] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:54.507477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:54.510072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:54.588489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65b3c-0646-410d-9320-7737ecff3a24 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:54.593196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:54.594553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:54.594889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:54.595216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:54.606619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:54.608179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c22b3-c2b1-4047-bb2b-f30a99d5a3e3 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:54.630413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 906/1802] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:54.671165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:54.795337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e832fe4-7372-4249-80da-ee4612509f27 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:54.810522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:54.810522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:54.810522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:54.810522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] PATH_INFO: `/v3/users/b90343c5ce5244698365908848916e4a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:54.815204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90343c5ce5244698365908848916e4a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:54.819403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:55.036645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90343c5ce5244698365908848916e4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:55.047671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90343c5ce5244698365908848916e4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:55.167880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90343c5ce5244698365908848916e4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:55.168685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90343c5ce5244698365908848916e4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:55.181946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90343c5ce5244698365908848916e4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:55.189040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 897/1803] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:54 2022] DELETE /identity/v3/users/b90343c5ce5244698365908848916e4a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:55.194840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:55.195116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:55.195414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:55.218229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:55.221552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:55.318416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 907/1804] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:55.329814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:55.331431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:55.434056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86059e-f6c8-4231-b777-e2f16f0727ae admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:55.439608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:55.440264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:55.440541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:55.440807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:55.456371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:55.456371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:55.480301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 898/1805] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:56.069652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:56.071141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:56.088175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de397e-49e9-4559-b12d-782e9b2934d3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:56.098885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:56.100323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:56.102120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:56.102501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] PATH_INFO: `/v3/projects/f8c955c989074830b3fbae27c544e359` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:56.105037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c955c989074830b3fbae27c544e359)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:56.107643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:56.279930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c955c989074830b3fbae27c544e359', 'request_id': 'req-516c5b14-422b-43a5-88e9-bc860292d8ec'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.288708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c955c989074830b3fbae27c544e359', 'request_id': 'req-516c5b14-422b-43a5-88e9-bc860292d8ec'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.396437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c955c989074830b3fbae27c544e359', 'request_id': 'req-516c5b14-422b-43a5-88e9-bc860292d8ec'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.410026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] The token cache is being invalidate because project f8c955c989074830b3fbae27c544e359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:56.410389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.411204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.413072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 908/1806] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:56 2022] DELETE /identity/v3/projects/f8c955c989074830b3fbae27c544e359 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:56.424507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:56.435898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d113ec6-44ee-4c5f-ae88-87079e4d47b3 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:56.518651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:56.520080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:56.521383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:56.521383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] PATH_INFO: `/v3/users/5f3f2766f55a4f4d89f058ed79ef4149` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:56.523505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3f2766f55a4f4d89f058ed79ef4149)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:56.526082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:56.770476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3f2766f55a4f4d89f058ed79ef4149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.785513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3f2766f55a4f4d89f058ed79ef4149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.880360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:56.881900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:56.917671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3f2766f55a4f4d89f058ed79ef4149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.919365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3f2766f55a4f4d89f058ed79ef4149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.939171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3391ac81-13a0-400c-9a40-6feaf31cbdb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3f2766f55a4f4d89f058ed79ef4149'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:56.955423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 899/1807] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:20:56 2022] DELETE /identity/v3/users/5f3f2766f55a4f4d89f058ed79ef4149 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:56.983749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c5b14-422b-43a5-88e9-bc860292d8ec admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:57.073126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:57.074188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:57.074906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:57.075543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:57.079152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:57.174264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:57.175816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18963390-7070-401b-9902-e3db1a82ee3c service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:57.189407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 909/1808] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:20:57.238850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:57.336691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:20:57.910831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36061-078a-4100-ae27-343d4654781a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:57.911471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36061-078a-4100-ae27-343d4654781a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:57.911471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc36061-078a-4100-ae27-343d4654781a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:57.913157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 900/1809] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:20:57.925756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:57.927402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:57.927402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:57.967011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:57.972559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:58.155138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 910/1810] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:20:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:58.387563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc36061-078a-4100-ae27-343d4654781a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:58.390556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4bc36061-078a-4100-ae27-343d4654781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:58.423962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:58.425702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:58.432364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc36061-078a-4100-ae27-343d4654781a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:58.463077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:58.467201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:58.470415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:58.470787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:58.502985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:58.504915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a73355-8a6b-4866-9874-24df98038f03 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:58.521859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 901/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:20:58.551774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6c19d-7338-41c7-a294-fbf57ffbb247 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:58.557712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:58.558460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:58.558948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:58.559419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] PATH_INFO: `/v3/projects/50b8460076c74b48b3d24936660c2478` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:58.561036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b8460076c74b48b3d24936660c2478)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:58.563891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:58.717946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b8460076c74b48b3d24936660c2478', 'request_id': 'req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:58.737503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b8460076c74b48b3d24936660c2478', 'request_id': 'req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:58.831117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b8460076c74b48b3d24936660c2478', 'request_id': 'req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:58.849873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] The token cache is being invalidate because project 50b8460076c74b48b3d24936660c2478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:20:58.850167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:58.851210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-15ac1213-fd16-4390-bc3d-ffbcc9cfef2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:20:58.858015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eaff-0860-4546-b221-938192ae135c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:58.858709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eaff-0860-4546-b221-938192ae135c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:58.859079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86eaff-0860-4546-b221-938192ae135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:58.862889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 911/1812] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:20:58 2022] DELETE /identity/v3/projects/50b8460076c74b48b3d24936660c2478 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:58.894531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9e86eaff-0860-4546-b221-938192ae135c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:58.896660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9e86eaff-0860-4546-b221-938192ae135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:59.022102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 902/1813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:59.030093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.030472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.030713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.076463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:59.077975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:59.111376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 912/1814] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:59.117831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86eaff-0860-4546-b221-938192ae135c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.133036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86eaff-0860-4546-b221-938192ae135c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.143581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.144407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.145165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.145359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.146263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:20:59.146795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.148705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.170732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 903/1815] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:20:59.179804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.190936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a569cd6-9016-4c09-b7a4-17de6f285bc1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.196429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.197064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.197341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.197610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.198244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.200221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.323691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 913/1816] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:59 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:59.328667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.345896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897eb8-c89b-4d7c-8a57-de6381b78c4b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.412991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.413572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.413851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.414120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.414741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.416701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.532082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 904/1817] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:20:59 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:20:59.536303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.548556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7d9a-7dea-41ec-881b-e5f6381f6217 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.553806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.555124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.555901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.556433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.557219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.559002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.578135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 914/1818] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:59.582603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.603465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e991-daa4-4090-b780-46e4d13306cc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.617084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.618020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.618707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.619122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.619965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.621760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de9980-ba91-4cd4-a691-98e900aab250 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.640243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 905/1819] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:20:59.644937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:20:59.661704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8843b-1715-422a-bd37-9e3f6c1e385a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:20:59.668839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:20:59.669771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.670193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.670660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] PATH_INFO: `/v3/projects/c5e30a91469d4898aeea5413cdba4c46/users/5878944c9ebf465789c83949ceb1fb32/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.712540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e30a91469d4898aeea5413cdba4c46, user_id=5878944c9ebf465789c83949ceb1fb32, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:20:59.716926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:20:59.846960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 915/1820] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:20:59 2022] PUT /identity/v3/projects/c5e30a91469d4898aeea5413cdba4c46/users/5878944c9ebf465789c83949ceb1fb32/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:20:59.857891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:20:59.858277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:20:59.858547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:20:59.886689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] MFA Rules not processed for user `5878944c9ebf465789c83949ceb1fb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:20:59.887927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:20:59.973080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 906/1821] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:20:59.973268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.035188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cda2ef-574b-4b42-bc76-5034f3f6499f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.040076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.040682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.040998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.041359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.041982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.043906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.249541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 916/1822] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:20:59 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:00.251555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.278432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f60bb-31d4-4d37-be94-8a17db8fb736 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.404070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.405401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.406497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.407208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.408510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.412303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.442404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:00.522855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 907/1823] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:00 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:00.527117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.538328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a4c5-d8e8-40e0-b67a-ae15f816e8bb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.542985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.543573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.543875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.544144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.544782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.546374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.558649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 917/1824] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:00.565617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.576195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d79b-6d92-47a4-bc4c-c54f31025f49 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.581017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.581713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.581988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.582258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] PATH_INFO: `/v3/projects/5a174893088b4bdb8fb095d433ba6033/users/225d877b4f7544be83a41b0d22dc07db/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.598643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a174893088b4bdb8fb095d433ba6033, user_id=225d877b4f7544be83a41b0d22dc07db, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.601403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.636920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:00.707647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 908/1825] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:00 2022] PUT /identity/v3/projects/5a174893088b4bdb8fb095d433ba6033/users/225d877b4f7544be83a41b0d22dc07db/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:00.712404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.724861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623d90-6109-41aa-9fea-18a0271b7381 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.886915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.887837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.891322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.891322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.891322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.892676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdc547-98a0-4165-bd80-1c57d5f4063d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.904089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 918/1826] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:00.909253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:00.920010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ba81b-2555-4a41-8a7e-c9dc1fb872c2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:00.926054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:00.926753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.927030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.927298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] PATH_INFO: `/v3/projects/5a174893088b4bdb8fb095d433ba6033/users/225d877b4f7544be83a41b0d22dc07db/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.929246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a174893088b4bdb8fb095d433ba6033, user_id=225d877b4f7544be83a41b0d22dc07db, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:00.932063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:00.943763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 909/1827] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:00 2022] PUT /identity/v3/projects/5a174893088b4bdb8fb095d433ba6033/users/225d877b4f7544be83a41b0d22dc07db/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:00.959634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:00.959634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:00.959634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:00.991485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] MFA Rules not processed for user `225d877b4f7544be83a41b0d22dc07db`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:00.993242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:01.067576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 919/1828] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:01.091480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:01.093901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:01.178700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db603-1ec8-4a05-aefc-f0ddac7a6683 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:01.183528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:01.184038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:01.184564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:01.185112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:01.197366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:01.198881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebf7b9-bd60-4ddf-a7be-55f5ae7a4257 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:01.212030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 910/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:01.293586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:01.361102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb49268-5fd6-4252-9523-b0493c5420ef None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:01.365793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:01.366485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:01.366757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:01.367029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] PATH_INFO: `/v3/users/5878944c9ebf465789c83949ceb1fb32` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:01.368296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5878944c9ebf465789c83949ceb1fb32)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:01.370541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:01.564843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5878944c9ebf465789c83949ceb1fb32'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:01.641168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5878944c9ebf465789c83949ceb1fb32'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:01.655544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5878944c9ebf465789c83949ceb1fb32'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:01.656598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5878944c9ebf465789c83949ceb1fb32'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:01.657578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5878944c9ebf465789c83949ceb1fb32'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:01.672320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 920/1830] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:01 2022] DELETE /identity/v3/users/5878944c9ebf465789c83949ceb1fb32 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:01.677223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:01.677723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:01.677723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:01.700322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:01.701614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:01.722362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:01.768274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 911/1831] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:01.780818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:01.783375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:01.853206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6ac1-d749-4b2b-9e1f-f8ad737f41c5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:01.860130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:01.860816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:01.861121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:01.861462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:01.873791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:01.876674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:01.894232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 921/1832] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:01.940113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:02.547266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:02.548782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:02.564104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f393bc3-372f-4163-8551-a1c5c8e35afe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:02.574965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:02.574965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:02.574965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:02.574965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] PATH_INFO: `/v3/projects/c5e30a91469d4898aeea5413cdba4c46` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:02.579101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e30a91469d4898aeea5413cdba4c46)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:02.579101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:02.770434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e30a91469d4898aeea5413cdba4c46', 'request_id': 'req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:02.786261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e30a91469d4898aeea5413cdba4c46', 'request_id': 'req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:02.881778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e30a91469d4898aeea5413cdba4c46', 'request_id': 'req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:02.896540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] The token cache is being invalidate because project c5e30a91469d4898aeea5413cdba4c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:02.896785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:02.897462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:02.899237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 912/1833] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:02 2022] DELETE /identity/v3/projects/c5e30a91469d4898aeea5413cdba4c46 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:02.905077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:02.917326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f3011-aded-4739-b04a-924147337c9d service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:02.992824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:02.993702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:02.994015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:02.994282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] PATH_INFO: `/v3/users/225d877b4f7544be83a41b0d22dc07db` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:02.995399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225d877b4f7544be83a41b0d22dc07db)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:02.997367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:03.032840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:03.199317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:03.222324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225d877b4f7544be83a41b0d22dc07db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:03.288498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225d877b4f7544be83a41b0d22dc07db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:03.303829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225d877b4f7544be83a41b0d22dc07db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:03.304619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225d877b4f7544be83a41b0d22dc07db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:03.305469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-62af34b4-895b-4c6d-a955-e4dd93756bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225d877b4f7544be83a41b0d22dc07db'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:03.320664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 922/1834] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:02 2022] DELETE /identity/v3/users/225d877b4f7544be83a41b0d22dc07db => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:03.659243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:03.665005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:03.677513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fe0-fb05-4af5-9dbf-edd8e34fe36f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:03.752916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:03.782234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:03.783075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:03.783277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:03.783666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] PATH_INFO: `/v3/users/8742268b96e849bdb42ea0fa28c1a544` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:03.785122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8742268b96e849bdb42ea0fa28c1a544)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:03.788442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:04.063315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8742268b96e849bdb42ea0fa28c1a544'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.074222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8742268b96e849bdb42ea0fa28c1a544'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.154100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8742268b96e849bdb42ea0fa28c1a544'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.155959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8742268b96e849bdb42ea0fa28c1a544'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.189561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8742268b96e849bdb42ea0fa28c1a544'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.199332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 913/1835] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:03 2022] DELETE /identity/v3/users/8742268b96e849bdb42ea0fa28c1a544 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:04.203979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:04.204811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:04.205236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:04.242651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:04.244435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:04.334943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 923/1836] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:04.351227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:04.352924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:04.474794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:04.487451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b7da-87ad-4523-914c-f78932f0528c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:04.493303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:04.495174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:04.495337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:04.495951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:04.508604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:04.510251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:04.524010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 914/1837] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:04.680812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:04.682167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:04.696476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47493a2-74ce-40a1-984c-34d1946a5533 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:04.709374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:04.710239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:04.710396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:04.710664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] PATH_INFO: `/v3/projects/5a174893088b4bdb8fb095d433ba6033` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:04.712384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a174893088b4bdb8fb095d433ba6033)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:04.717421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:04.909541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a174893088b4bdb8fb095d433ba6033', 'request_id': 'req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:04.917040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a174893088b4bdb8fb095d433ba6033', 'request_id': 'req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.071742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.073463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.088349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a174893088b4bdb8fb095d433ba6033', 'request_id': 'req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.090652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c1fd8-eebb-4efc-bc77-437514b38d8f service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.105797 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] The token cache is being invalidate because project 5a174893088b4bdb8fb095d433ba6033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:05.106286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.107341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-afcf7ef9-8856-4cd7-9b02-1e402bbbb080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.109618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 924/1838] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:04 2022] DELETE /identity/v3/projects/5a174893088b4bdb8fb095d433ba6033 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:05.118357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.119087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.119657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.152166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:05.153577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.174195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.174195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.174195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.174195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] PATH_INFO: `/v3/users/e8840533b186459dbd08738dfc956de1` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.175029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8840533b186459dbd08738dfc956de1)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.175029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:05.232720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 925/1839] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:05.235072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.236656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.249577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119e6e-3393-4a9e-b89e-8c127cdf3539 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.254348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.254987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.255261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.255526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] PATH_INFO: `/v3/projects/11d7f42f91ef405c8df8f7ba5e1a3325` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.256716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d7f42f91ef405c8df8f7ba5e1a3325)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.258602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:05.496916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8840533b186459dbd08738dfc956de1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.507310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d7f42f91ef405c8df8f7ba5e1a3325', 'request_id': 'req-ffc64fad-2b62-41c6-b6aa-87e8c6736960'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.523138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d7f42f91ef405c8df8f7ba5e1a3325', 'request_id': 'req-ffc64fad-2b62-41c6-b6aa-87e8c6736960'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.523389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8840533b186459dbd08738dfc956de1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.593108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d7f42f91ef405c8df8f7ba5e1a3325', 'request_id': 'req-ffc64fad-2b62-41c6-b6aa-87e8c6736960'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.615456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] The token cache is being invalidate because project 11d7f42f91ef405c8df8f7ba5e1a3325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:05.615877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.617119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ffc64fad-2b62-41c6-b6aa-87e8c6736960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.620272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 926/1840] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:05 2022] DELETE /identity/v3/projects/11d7f42f91ef405c8df8f7ba5e1a3325 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:05.621913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20380087-e1ba-4a88-a987-5f9123f8bd31 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.622261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20380087-e1ba-4a88-a987-5f9123f8bd31 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.623290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20380087-e1ba-4a88-a987-5f9123f8bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.670821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8840533b186459dbd08738dfc956de1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.672200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8840533b186459dbd08738dfc956de1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.675331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-20380087-e1ba-4a88-a987-5f9123f8bd31 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:05.675331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-20380087-e1ba-4a88-a987-5f9123f8bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.688167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8840533b186459dbd08738dfc956de1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:05.694649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 915/1841] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:05 2022] DELETE /identity/v3/users/e8840533b186459dbd08738dfc956de1 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:05.697244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.698964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.761013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 927/1842] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:05.764696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.765255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.765811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.797651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:05.799942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.803700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c389b-a66e-4002-95e5-4135b899bb66 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.813089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.813801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.814090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.814369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] PATH_INFO: `/v3/users/8d761f10b03e4329b879d39c536dab41` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.820121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d761f10b03e4329b879d39c536dab41)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.820350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 928/1843] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:05.820350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.827041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:05.830213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162a0a-5023-4e42-99b2-6d48ac47d65a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.837101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.837340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.837474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.837742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.838388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:05.838683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.840551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:05.859184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 929/1844] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:05.859184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.861152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:05.927605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7995b6-7b5a-4a63-81e1-5892890bd7a8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.934283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.935358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.935898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.936430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.952176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.955518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:05.958837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:05.969801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 930/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:05.970491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:05.980556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22ac11-8473-416c-aa94-9f4ccf121603 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:05.986830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:05.987820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:05.988253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:05.989680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:05.989680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:05.991253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.078856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d761f10b03e4329b879d39c536dab41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.108774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d761f10b03e4329b879d39c536dab41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.112620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 931/1846] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:05 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:06.117379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:06.271862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b32d8-a642-4ee6-ab57-52a23ff6e88f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:06.278646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:06.279218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.279664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.280168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.281208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:06.284825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.302461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d761f10b03e4329b879d39c536dab41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.302461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d761f10b03e4329b879d39c536dab41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.323607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d761f10b03e4329b879d39c536dab41'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.336726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 916/1847] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:05 2022] DELETE /identity/v3/users/8d761f10b03e4329b879d39c536dab41 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:06.440042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 932/1848] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:06 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:06.442284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:06.447031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:06.530547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8569-df6b-4629-ad0e-08b243d6301f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:06.536364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:06.536985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.537263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.537535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.538188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:06.539849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.551087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 917/1849] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:06.555341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:06.566934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca017c-775c-45a5-81fd-1268246bcab1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:06.573226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:06.574151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.574545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.574929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.576154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:06.578969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.595172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 933/1850] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:06.599733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:06.610849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c690-6965-49e3-a458-543a2769fd1a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:06.616397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:06.617164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.617440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.617721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] PATH_INFO: `/v3/projects/5e710852256f4e0b8e994bf941ddc5e3/users/ce6055935f714d4a9631ec534bc77ffd/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.636310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e710852256f4e0b8e994bf941ddc5e3, user_id=ce6055935f714d4a9631ec534bc77ffd, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:06.638563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0c144-4b49-425f-9b24-a0e3f48b851f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.651518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:06.653408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:06.668554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0077b5-281e-4565-a48c-6c5d4a2f76e5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:06.675828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:06.676713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.677069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.677414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] PATH_INFO: `/v3/projects/a95bf87e43e84c5ca404826c70219e77` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.678789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95bf87e43e84c5ca404826c70219e77)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:06.680842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:06.773820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 918/1851] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:06 2022] PUT /identity/v3/projects/5e710852256f4e0b8e994bf941ddc5e3/users/ce6055935f714d4a9631ec534bc77ffd/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:06.775370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:06.775654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:06.776106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:06.818796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] MFA Rules not processed for user `ce6055935f714d4a9631ec534bc77ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:06.821053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:06.887617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95bf87e43e84c5ca404826c70219e77', 'request_id': 'req-523c4921-11ee-4368-9ccf-514ced135494'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.901275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95bf87e43e84c5ca404826c70219e77', 'request_id': 'req-523c4921-11ee-4368-9ccf-514ced135494'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:06.958564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 919/1852] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:06.965435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:07.004673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95bf87e43e84c5ca404826c70219e77', 'request_id': 'req-523c4921-11ee-4368-9ccf-514ced135494'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.031849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] The token cache is being invalidate because project a95bf87e43e84c5ca404826c70219e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:07.031849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.033509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.038078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 934/1853] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:06 2022] DELETE /identity/v3/projects/a95bf87e43e84c5ca404826c70219e77 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:07.043296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:07.050721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:07.097852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:07.167132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2550c-f862-4829-8a6c-d1d5421f861a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:07.220038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4921-11ee-4368-9ccf-514ced135494 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:07.225061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:07.225879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.226263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.226432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] PATH_INFO: `/v3/users/bf8e3e49983c44169def21be428928aa` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.227614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8e3e49983c44169def21be428928aa)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:07.229573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:07.260785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:07.261870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.262325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.262775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.263891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:07.269559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:07.399131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 920/1854] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:06 2022] POST /identity/v3/projects => generated 387 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:07.406362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:07.412699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:07.508890 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8e3e49983c44169def21be428928aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.517633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e0cb3-19e4-4ac9-a0e6-9ab8b688987a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:07.523414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:07.524577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.524867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.525144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] PATH_INFO: `/v3/projects/983b063a8d354d7182a9a651278744a2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.526354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983b063a8d354d7182a9a651278744a2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:07.528352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:07.605371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8e3e49983c44169def21be428928aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.623399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8e3e49983c44169def21be428928aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.624317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8e3e49983c44169def21be428928aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.625551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8e3e49983c44169def21be428928aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.645504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 935/1855] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:07 2022] DELETE /identity/v3/users/bf8e3e49983c44169def21be428928aa => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:07.646789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:07.648721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:07.721120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983b063a8d354d7182a9a651278744a2', 'request_id': 'req-1d510964-f697-4faa-bcef-450eeebc6634'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.736804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983b063a8d354d7182a9a651278744a2', 'request_id': 'req-1d510964-f697-4faa-bcef-450eeebc6634'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.774948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60c3e-293a-489a-a3e7-c6c3c9c66918 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:07.838927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983b063a8d354d7182a9a651278744a2', 'request_id': 'req-1d510964-f697-4faa-bcef-450eeebc6634'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.858487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] The token cache is being invalidate because project 983b063a8d354d7182a9a651278744a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:07.859964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.861218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1d510964-f697-4faa-bcef-450eeebc6634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:07.867126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 921/1856] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:07 2022] DELETE /identity/v3/projects/983b063a8d354d7182a9a651278744a2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:07.870731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838aa02-e64e-43f7-ab60-9c2de01365d1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.871486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838aa02-e64e-43f7-ab60-9c2de01365d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.877072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838aa02-e64e-43f7-ab60-9c2de01365d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.877241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:07.877241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:07.877677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.878278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.878793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.879974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:07.882550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:07.904462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7838aa02-e64e-43f7-ab60-9c2de01365d1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:07.906862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7838aa02-e64e-43f7-ab60-9c2de01365d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:07.923142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 922/1857] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:07.932029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:07.932496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:07.933026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:07.957065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:07.958315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:07.986904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:07.996748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 936/1858] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:07 2022] POST /identity/v3/users => generated 300 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:08.013986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.015028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 923/1859] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:08.017003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:08.023323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.049031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd5cb-6898-4ed6-9c9b-324a55cd0a5a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.049448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a75f-4030-4189-9717-18e0ac501a4a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.058927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.059785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.060317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.060743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.061553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:08.062286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.065738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.065738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.066279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.066425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.066425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.066661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.069815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.083582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 937/1860] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:08.090385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.119907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 924/1861] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:08.121472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.125450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5191e79-2157-4cb3-9c4d-d9b773d37864 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.132541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.133315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.133936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.134116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] PATH_INFO: `/v3/projects/a03cecd0aec6475b93be14694bf75587/users/b05029161f8c4a7caef549ae97c56de3/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.163823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03cecd0aec6475b93be14694bf75587, user_id=b05029161f8c4a7caef549ae97c56de3, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.163823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.177512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd80be-be01-43ae-bf4e-b6025015f7e7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.205564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.206629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.207115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.207590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.208718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.212202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.282176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 938/1862] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:08 2022] PUT /identity/v3/projects/a03cecd0aec6475b93be14694bf75587/users/b05029161f8c4a7caef549ae97c56de3/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:08.288898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.389363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 925/1863] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:08 2022] POST /identity/v3/projects => generated 407 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:08.394774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.404039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d05fb5-0f8c-4e89-a75d-053cdc5a2c71 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.517273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.518557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.520258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.520688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.524990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.527099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.529009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f6a88-83eb-4e79-95c1-bbfddda876d7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.534998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.535641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.536142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.536584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.537213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.539422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.565708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 939/1864] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:08.567023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.569592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:08.608407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae4609-b67e-4ef6-bb67-8fd0ab6431b0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.622538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.622538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.622988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.622988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] PATH_INFO: `/v3/projects/7d625f4bf12b459dbd2182746aff1135` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.624416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d625f4bf12b459dbd2182746aff1135)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.626658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.667836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 926/1865] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:08 2022] POST /identity/v3/users => generated 304 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:08.672745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.716098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b91c6-ce34-412a-a94c-d0c5a5b6b47f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:08.744363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:08.745167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:08.745430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:08.745706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] PATH_INFO: `/v3/projects/a03cecd0aec6475b93be14694bf75587/users/b05029161f8c4a7caef549ae97c56de3/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:08.755074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03cecd0aec6475b93be14694bf75587, user_id=b05029161f8c4a7caef549ae97c56de3, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:08.770760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:08.811786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 927/1866] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:08 2022] PUT /identity/v3/projects/a03cecd0aec6475b93be14694bf75587/users/b05029161f8c4a7caef549ae97c56de3/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:08.815023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:08.853202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d625f4bf12b459dbd2182746aff1135', 'request_id': 'req-112d4399-b554-4aec-8945-1b77a31007ef'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:08.863655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d625f4bf12b459dbd2182746aff1135', 'request_id': 'req-112d4399-b554-4aec-8945-1b77a31007ef'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:08.935084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb3b1-76c3-4c95-abe0-cd893a4873ea admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.023664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d625f4bf12b459dbd2182746aff1135', 'request_id': 'req-112d4399-b554-4aec-8945-1b77a31007ef'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:09.047487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] The token cache is being invalidate because project 7d625f4bf12b459dbd2182746aff1135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:09.048126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:09.049236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-112d4399-b554-4aec-8945-1b77a31007ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:09.065510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:09.081394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 940/1867] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:08 2022] DELETE /identity/v3/projects/7d625f4bf12b459dbd2182746aff1135 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:09.082908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.083194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.083471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.103901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.104645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.104991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.105330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.106057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.107891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d890f-ac40-40b3-bba2-6cb2d309200b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.121264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 928/1868] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:09.122929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.123408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.133644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.134465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] MFA Rules not processed for user `b05029161f8c4a7caef549ae97c56de3`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:09.136616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.159827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:09.165810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.183885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 929/1869] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:09.183885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.188690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.209287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177865-92cb-4eff-80e6-bf315f33f697 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.224428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.224428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.224428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.224428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.226336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.236693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c110c-66bb-4aa8-aceb-090f4b82392a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.267056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 930/1870] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:09.269088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.269391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.269675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.278871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 941/1871] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:09.279708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.292641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:09.293853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.299546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7fcbd-825c-43d5-b6a9-36270197328d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.302700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 931/1872] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:09.303557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.306931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.307334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.308501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.308991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.309463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] PATH_INFO: `/v3/projects/beb97837f0504514b2bac3e12b14b810/users/e2bec50fdd9e4aca9400fbb23858e0b8/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.337171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb97837f0504514b2bac3e12b14b810, user_id=e2bec50fdd9e4aca9400fbb23858e0b8, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.342040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f40d2-ef8f-44d8-b8c2-099e428e8dc2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.373169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04cd0-4821-475e-8c7e-db34cc53caec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.379672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.380532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.380962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.381356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.401553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.404542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.424156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 932/1873] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:09.425734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.444870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550b0af-84b7-4dc9-8321-a7b9b10f52d0 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.453609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.454640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.455143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.456375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.456375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:09.456836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.459484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.475630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 933/1874] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:09.481036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.485107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 942/1875] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:09 2022] PUT /identity/v3/projects/beb97837f0504514b2bac3e12b14b810/users/e2bec50fdd9e4aca9400fbb23858e0b8/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:09.496644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25652-f047-4bfc-a2e1-a92000f4d0c7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.497806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.498092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.498365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.554191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] MFA Rules not processed for user `e2bec50fdd9e4aca9400fbb23858e0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:09.566588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:09.666797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.667487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.667701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.667989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.668740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.671035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.687514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:09.732276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 943/1876] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:09.739116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.789844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e18b4-77de-4e88-ac93-132d9a1b7ab6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:09.798072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:09.799436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:09.799809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:09.800228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:09.800923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:09.802932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:09.851378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 934/1877] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/projects => generated 375 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:09.852463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.912315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 944/1878] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/projects => generated 407 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:09.924447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:09.964064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a709-4b7a-4fb5-853c-627a798772be admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.047960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.048716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.056254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.056254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.056254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.056254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.082388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29669e2-630e-4529-8034-98e5683e63c7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.108050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.109940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.110597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.112516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.112516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.117426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.186959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 935/1879] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:10.195724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.211686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba4e6a-b331-403e-ab66-4ab4ff6dc4b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.226857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.231445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.231445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.231445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.231445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.231445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.244370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 936/1880] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:10.248714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.263030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 945/1881] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:09 2022] POST /identity/v3/users => generated 310 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:10.268468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:10.269179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.283618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a70ff-c931-4388-9001-8147c13e7188 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.304730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033faac-21da-4e64-9b6e-45fdcc9508f8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.306700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.307994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.308461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.309001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.310553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.314497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.315567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.316114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.316484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.316736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.317882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.321827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.340948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 946/1882] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:10.346804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.366072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 937/1883] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:10.367692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.375923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa3059-191a-47a0-ae7f-7bf4f6187976 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.383254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.384072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.384444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.384810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] PATH_INFO: `/v3/projects/4238e90e8bd74b7d8f624d21db260970/users/387b9039b89f4d4b84d62ed183b841a7/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.412047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858aa2-9deb-47df-bc7f-4fbfa60071c9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.422765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4238e90e8bd74b7d8f624d21db260970, user_id=387b9039b89f4d4b84d62ed183b841a7, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.422907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.422907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.423144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e5292-6e86-4bb0-92d1-e6cd90b45ec4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.423253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.423253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] PATH_INFO: `/v3/projects/7908a2cf56bb4adeb60cb0769e56dd52/users/4e2f70d07a614ecea11098daf28e8116/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.443019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7908a2cf56bb4adeb60cb0769e56dd52, user_id=4e2f70d07a614ecea11098daf28e8116, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.452572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.581533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 938/1884] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:10 2022] PUT /identity/v3/projects/7908a2cf56bb4adeb60cb0769e56dd52/users/4e2f70d07a614ecea11098daf28e8116/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:10.588163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 947/1885] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:10 2022] PUT /identity/v3/projects/4238e90e8bd74b7d8f624d21db260970/users/387b9039b89f4d4b84d62ed183b841a7/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:10.590907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.600503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.600774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.601040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.637201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] MFA Rules not processed for user `4e2f70d07a614ecea11098daf28e8116`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:10.638649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:10.673105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c6b2-16a2-472a-afe3-784895ff9c5b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.735525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 948/1886] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:10.739706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.758112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.758732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.759011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.759288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.759962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.761807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.774360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 939/1887] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:10.791544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:10.816374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88828cbd-6aa8-47a5-a5af-809eb20e04f6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.835237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:10.837054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.838342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.838826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] PATH_INFO: `/v3/projects/4238e90e8bd74b7d8f624d21db260970/users/387b9039b89f4d4b84d62ed183b841a7/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.844050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4238e90e8bd74b7d8f624d21db260970, user_id=387b9039b89f4d4b84d62ed183b841a7, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:10.847404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:10.849248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404c3d-9626-4902-bc0d-b255c59ca74c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:10.875857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 940/1888] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:10 2022] PUT /identity/v3/projects/4238e90e8bd74b7d8f624d21db260970/users/387b9039b89f4d4b84d62ed183b841a7/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:10.884639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5b0b6-e5be-4cc4-b81a-304dad81d46e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:10.895627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:10.896713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:10.896713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:10.951447 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] MFA Rules not processed for user `387b9039b89f4d4b84d62ed183b841a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:10.953886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:11.011884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.013126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.015281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.016041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.017168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.019430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.101648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 941/1889] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:11.116859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.118857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:11.159570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 949/1890] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:10 2022] POST /identity/v3/projects => generated 375 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:11.163500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.260761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87912b01-42b1-4aac-a28a-626eb8607a08 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.295217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d24f1-8fed-49cf-81b6-2dfb54962ba7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.306418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.307551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.308143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.308580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.310307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.315605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.341307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.341972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.342251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.342542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.438709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.440805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.459505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 942/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:11 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:11.474613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.478950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:11.489015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 950/1892] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:11 2022] POST /identity/v3/users => generated 294 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:11.489015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.510096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9583e68-6129-4937-963b-c8283fdc66dc service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.520220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.521499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.522122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.522876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] PATH_INFO: `/v3/users/ce6055935f714d4a9631ec534bc77ffd` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.525355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6055935f714d4a9631ec534bc77ffd)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.526012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464bf33-b1e1-4cd3-8c20-354d01bd3e7d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.531582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.539602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.540719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.544925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.544925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.544925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.545795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.575630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 951/1893] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:11.582772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.610676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e75038-ac83-474b-a99d-b029507d2e74 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.619254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.621130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.621130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.621397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] PATH_INFO: `/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0/users/8c0bd80d6ffd45a4b4a2d91c5d45822d/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.653471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:11.665809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431cff8657ef4fdba2ca58ecf3bab1e0, user_id=8c0bd80d6ffd45a4b4a2d91c5d45822d, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.678894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.770012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 952/1894] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:11 2022] PUT /identity/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0/users/8c0bd80d6ffd45a4b4a2d91c5d45822d/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:11.775786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.824121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6055935f714d4a9631ec534bc77ffd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:11.836945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6055935f714d4a9631ec534bc77ffd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:11.852266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:11.896930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6055935f714d4a9631ec534bc77ffd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:11.897989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6055935f714d4a9631ec534bc77ffd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:11.910766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149696-6d0c-4b4b-9633-c1f67b259773 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:11.916432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:11.917212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.917396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.917679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:11.918345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:11.920231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:11.930067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f865c5b0-c569-4cdd-b9eb-6dc0b2d87241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6055935f714d4a9631ec534bc77ffd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:11.934887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 953/1895] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:11.941857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 943/1896] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:11 2022] DELETE /identity/v3/users/ce6055935f714d4a9631ec534bc77ffd => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:11.943864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:11.946698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:11.953211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:11.953679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:11.954148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.005356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d428a-4aca-47ce-820c-122c6b947acf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:12.034141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:12.036152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.166531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:12.167621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:12.168081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:12.168523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] PATH_INFO: `/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0/users/8c0bd80d6ffd45a4b4a2d91c5d45822d/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.172473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] RBAC: Authorizing `identity:create_grant(project_id=431cff8657ef4fdba2ca58ecf3bab1e0, user_id=8c0bd80d6ffd45a4b4a2d91c5d45822d, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:12.179783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:12.190139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 944/1897] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:12.190139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:12.190751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.201464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 954/1898] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:11 2022] PUT /identity/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0/users/8c0bd80d6ffd45a4b4a2d91c5d45822d/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:12.211724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:12.217791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.267295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:12.292570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:12.339745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890088f2-3145-4098-a768-37f37aae26df admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:12.341749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93874870-b4b7-4df9-b8a6-09af629003be None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:12.344558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:12.345223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:12.345501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:12.345767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.481591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:12.485128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b186905-5cf0-48db-abcc-bd807e6b4551 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:12.506116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 955/1899] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:12.507007 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:12.507289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:12.507557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.547652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:12.550538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] MFA Rules not processed for user `8c0bd80d6ffd45a4b4a2d91c5d45822d`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:12.552063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.572153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:12.573320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:12.573874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:12.574452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.579162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.679800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:12.738554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 956/1900] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:12.769488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:12.769726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:12.771059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:12.774517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.794575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 945/1901] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:12 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:12.807812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea912ea-4f83-40ae-90ad-c1f7a60966de None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:12.830001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:12.830001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:12.830001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:12.830001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:12.830557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:12.975632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:12.979791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:12.980036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:13.006954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 957/1902] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:13.321403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:13.327985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:13.330455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:13.353838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3c84e-20ea-4c7f-ac6e-29591d2bea22 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:13.361749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:13.362647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:13.362893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:13.363576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] PATH_INFO: `/v3/projects/5e710852256f4e0b8e994bf941ddc5e3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:13.364561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e710852256f4e0b8e994bf941ddc5e3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:13.367830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:13.547424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e710852256f4e0b8e994bf941ddc5e3', 'request_id': 'req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:13.558298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e710852256f4e0b8e994bf941ddc5e3', 'request_id': 'req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:13.687602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e710852256f4e0b8e994bf941ddc5e3', 'request_id': 'req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:13.706294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] The token cache is being invalidate because project 5e710852256f4e0b8e994bf941ddc5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:13.706784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:13.707843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:13.710046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 946/1903] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:13 2022] DELETE /identity/v3/projects/5e710852256f4e0b8e994bf941ddc5e3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:13.715096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:13.737632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dea50-99f4-4113-b68e-f926c2fadd6e service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:13.802331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:13.825309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:13.825858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:13.826185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:13.826411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] PATH_INFO: `/v3/users/b05029161f8c4a7caef549ae97c56de3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:13.828338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05029161f8c4a7caef549ae97c56de3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:13.830362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:14.132150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05029161f8c4a7caef549ae97c56de3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:14.160394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:14.200358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05029161f8c4a7caef549ae97c56de3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:14.229987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:14.254139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05029161f8c4a7caef549ae97c56de3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:14.258947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05029161f8c4a7caef549ae97c56de3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:14.260191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05029161f8c4a7caef549ae97c56de3'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:14.308782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 958/1904] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:13 2022] DELETE /identity/v3/users/b05029161f8c4a7caef549ae97c56de3 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:14.604437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:14.671967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:14.851405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:14.853682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:14.897813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaa3b-ac35-4eb3-872f-4c5fe1889f54 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:14.976839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:15.030398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:15.032232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.032689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.033190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] PATH_INFO: `/v3/users/9713981df78d40dc90422e581022532b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.035397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9713981df78d40dc90422e581022532b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:15.038432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:15.066381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:15.068804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:15.106442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3a55-2e9f-45a1-a767-45ee9b1808a4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:15.117390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:15.122941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.124141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.125744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] PATH_INFO: `/v3/projects/a03cecd0aec6475b93be14694bf75587` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.127802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03cecd0aec6475b93be14694bf75587)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:15.130129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:15.384413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9713981df78d40dc90422e581022532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.390667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03cecd0aec6475b93be14694bf75587', 'request_id': 'req-6ebac2b2-64b2-4955-8e28-ebf700962cbd'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.398417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9713981df78d40dc90422e581022532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.400775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03cecd0aec6475b93be14694bf75587', 'request_id': 'req-6ebac2b2-64b2-4955-8e28-ebf700962cbd'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.494089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:15.588536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9713981df78d40dc90422e581022532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.589675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9713981df78d40dc90422e581022532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.616261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7b678563-dc26-4373-9f71-8441c9f6e1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9713981df78d40dc90422e581022532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.631108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 947/1905] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:14 2022] DELETE /identity/v3/users/9713981df78d40dc90422e581022532b => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:15.638150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.638436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.638807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.663904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:15.665171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:15.666144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03cecd0aec6475b93be14694bf75587', 'request_id': 'req-6ebac2b2-64b2-4955-8e28-ebf700962cbd'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.684975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] The token cache is being invalidate because project a03cecd0aec6475b93be14694bf75587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:15.685279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.686183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6ebac2b2-64b2-4955-8e28-ebf700962cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:15.694660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 959/1906] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:15 2022] DELETE /identity/v3/projects/a03cecd0aec6475b93be14694bf75587 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:15.696800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c08f-50b0-4616-87c5-b1c45fca3832 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.697789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c08f-50b0-4616-87c5-b1c45fca3832 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.698959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c08f-50b0-4616-87c5-b1c45fca3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.732853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-5983c08f-50b0-4616-87c5-b1c45fca3832 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:15.735120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5983c08f-50b0-4616-87c5-b1c45fca3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:15.780128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 948/1907] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:15.795996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:15.798755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:15.840740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 960/1908] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:15.850446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.851309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.851788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.889046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:15.889803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:15.893436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:15.898892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581713a-519b-46c2-ab62-8290f4440766 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:15.905095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:15.907119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.907630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.908156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.925385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 961/1909] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:15.927351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:15.930206 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:15.931952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:15.943900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 949/1910] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:15.945357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a510-ca3b-42de-8a10-d0307cf1b5af None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:15.953321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:15.954114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:15.957962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:15.957962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:15.957962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:15.957962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:15.959852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:15.995444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 962/1911] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:16.002880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.019598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c34393-9398-49a1-92f0-7ca27d59ffa8 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.037806 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.038696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.038997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.039300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.040011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.042087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.088365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:16.151077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 950/1912] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:16 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:16.153571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.164635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6288202-1e9e-4e6a-8b14-55666cf41fe0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.268452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.269556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.269556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.269556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.270268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.272539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.363586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:16.381851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 963/1913] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:16 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:16.387169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.411164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5641c6-efdb-4c0e-acdc-32f7e5316b99 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.420803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.422006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.422631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.423832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.439133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.449739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.476312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 951/1914] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:16.482814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.510105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704f7ae-3246-4046-98bc-edbbf2fd5c40 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.521596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:16.527898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.528962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.529432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.529903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.531545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.534472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.576276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 964/1915] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:16.583638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.600956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21a62-235f-4d20-b328-1d3ebc3390a0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.626077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.627415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.627983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.628420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] PATH_INFO: `/v3/projects/d83845559d3a453b865467e555e192df/users/577a9688129343d3ae61163a37ad8484/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.656278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83845559d3a453b865467e555e192df, user_id=577a9688129343d3ae61163a37ad8484, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.661945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3862269-265d-4dac-bd11-abc0cf5eb682 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.709619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:16.712696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:16.734709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c77e-30a4-4dc7-85c1-3b79670774a7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:16.745162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:16.746218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.748109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.748731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] PATH_INFO: `/v3/projects/9347d06864f0454db991834b0edfacb5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.751530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9347d06864f0454db991834b0edfacb5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:16.757475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:16.773462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 952/1916] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:16 2022] PUT /identity/v3/projects/d83845559d3a453b865467e555e192df/users/577a9688129343d3ae61163a37ad8484/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:16.788078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:16.790293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:16.791696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:16.839914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] MFA Rules not processed for user `577a9688129343d3ae61163a37ad8484`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:16.841168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:16.934560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9347d06864f0454db991834b0edfacb5', 'request_id': 'req-9379c2d1-406e-4d84-913d-42cdbebaf0b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:16.949117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9347d06864f0454db991834b0edfacb5', 'request_id': 'req-9379c2d1-406e-4d84-913d-42cdbebaf0b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:16.971279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 953/1917] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:16.976074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:17.065959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9347d06864f0454db991834b0edfacb5', 'request_id': 'req-9379c2d1-406e-4d84-913d-42cdbebaf0b5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.100022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] The token cache is being invalidate because project 9347d06864f0454db991834b0edfacb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:17.100916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.104900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2bc58-9b34-41d3-ac4b-714ea5bba7d6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:17.111329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.113559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 965/1918] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:16 2022] DELETE /identity/v3/projects/9347d06864f0454db991834b0edfacb5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:17.121695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:17.127309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:17.164724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:17.221681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:17.320446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:17.321121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:17.321398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:17.321674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:17.322364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:17.324468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:17.347794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c2d1-406e-4d84-913d-42cdbebaf0b5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:17.356765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:17.358505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:17.360253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:17.361306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] PATH_INFO: `/v3/users/e0ba497212d54e17b6e18917b1a0476e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:17.364101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ba497212d54e17b6e18917b1a0476e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:17.368150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:17.435226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:17.475276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 954/1919] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:16 2022] POST /identity/v3/projects => generated 381 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:17.482098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:17.485383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:17.603642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfda0d-a6dc-491c-937c-3022a06c69dd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:17.606744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ba497212d54e17b6e18917b1a0476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.609927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:17.610679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:17.611563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:17.611563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:17.612023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:17.614384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:17.713382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ba497212d54e17b6e18917b1a0476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.731990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ba497212d54e17b6e18917b1a0476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.732891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ba497212d54e17b6e18917b1a0476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.733703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ba497212d54e17b6e18917b1a0476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:17.750751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 966/1920] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:17 2022] DELETE /identity/v3/users/e0ba497212d54e17b6e18917b1a0476e => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:17.773190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 955/1921] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:17 2022] POST /identity/v3/users => generated 297 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:17.776710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:17.779695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:17.911618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253330-b684-4f6f-bc9d-fb2f799e562b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:17.923209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:17.924318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:17.924812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:17.925311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:17.926506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:17.929759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:17.980983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 967/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:17.987244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:18.002014 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc3ed-4002-499c-b73e-1f0a5819e049 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:18.009281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:18.011905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:18.012187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:18.012482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] PATH_INFO: `/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce/users/895e47fd65b34d59bec6847449522a23/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:18.031739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0690bb37ce48b8aa4605ce7130f8ce, user_id=895e47fd65b34d59bec6847449522a23, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:18.034565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:18.050556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:18.144828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 956/1923] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:17 2022] PUT /identity/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce/users/895e47fd65b34d59bec6847449522a23/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:18.151000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:18.170868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082258eb-4993-4f6d-8972-97c411412c69 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:18.287324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:18.393020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:18.393020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:18.393020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:18.393020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:18.393533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:18.393533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:18.432922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 968/1924] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:18.438861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:18.465741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485585-2096-42ab-82d7-9da05d2d7436 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:18.480201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:18.480907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:18.481165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:18.481435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] PATH_INFO: `/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce/users/895e47fd65b34d59bec6847449522a23/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:18.485565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0690bb37ce48b8aa4605ce7130f8ce, user_id=895e47fd65b34d59bec6847449522a23, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:18.493657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14b007-2935-4a74-8f29-61569278591c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:18.512432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:18.516199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:18.545794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 957/1925] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:18 2022] PUT /identity/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce/users/895e47fd65b34d59bec6847449522a23/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:18.551500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:18.552059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:18.552764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:18.635495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] MFA Rules not processed for user `895e47fd65b34d59bec6847449522a23`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:18.639217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:18.670903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5325cd-8256-426e-a4b6-a0a9d5d94603 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:18.759587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:18.765920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.277712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.277712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.277712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.277712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.279166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 958/1926] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:19.279166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:19.279166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.279935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.279935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b11e71-3454-4fb8-88d1-c3faf5096691 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:19.279935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 969/1927] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:19.280944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76452b5e-f3e3-4a83-83e6-f9edebbc3343 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:19.280944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.280944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.280944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.281525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] PATH_INFO: `/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.281525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2847ea517546dfbc5c6f99b00d9ec3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.281525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:19.281525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=4,keystone:SELECT=93,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:19.281525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2847ea517546dfbc5c6f99b00d9ec3', 'request_id': 'req-9a20991b-dd87-43da-852e-48791f0a6644'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:19.282237 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2847ea517546dfbc5c6f99b00d9ec3', 'request_id': 'req-9a20991b-dd87-43da-852e-48791f0a6644'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:19.334965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2847ea517546dfbc5c6f99b00d9ec3', 'request_id': 'req-9a20991b-dd87-43da-852e-48791f0a6644'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:19.383190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] The token cache is being invalidate because project 4e2847ea517546dfbc5c6f99b00d9ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:19.383190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:19.383190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:19.385571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 959/1928] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:18 2022] DELETE /identity/v3/projects/4e2847ea517546dfbc5c6f99b00d9ec3 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:19.391882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fcda-1cd0-4d83-b70e-8c2f5530c51c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.392428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fcda-1cd0-4d83-b70e-8c2f5530c51c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.392911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6fcda-1cd0-4d83-b70e-8c2f5530c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.449068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-65d6fcda-1cd0-4d83-b70e-8c2f5530c51c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:19.449068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-65d6fcda-1cd0-4d83-b70e-8c2f5530c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.449947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:19.449947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.520957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 970/1929] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:19.532410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.533283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.533765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.540723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20991b-dd87-43da-852e-48791f0a6644 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:19.545435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.546195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.546675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.546957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.549965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.579270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:19.581692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:19.605914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 971/1930] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:19.608220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:19.628506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7573ce-f9bf-43c4-bc16-5d55f76693d5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:19.641684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.643160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.643807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.645323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.646610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:19.647426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.648929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.650433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:19.650621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:19.665021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 960/1931] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:19.673839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 972/1932] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:19.687109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:19.694980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa8749-8a81-43a3-812a-47320ed94084 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:19.703166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.704313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.704825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.705362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.706358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.709733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:19.771094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:19.831932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 961/1933] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:19 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:19.838059 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:19.862888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28da7-d977-4be7-a989-794042e2144d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:19.936517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:19.938024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:19.938380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:19.938891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:19.940136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:19.944101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.017499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.020082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:20.050104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 973/1934] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:19 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:20.056262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.076429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f150-da64-4902-bad5-e829ad070bef admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:20.087629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:20.090090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.090290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.090775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.093031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:20.096401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.112376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0fae-2401-4f73-a0b5-3c9a8cb890ec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:20.117302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:20.118282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.119409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.120109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.123171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:20.123989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 974/1935] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:20.128218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.141630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:20.146176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0ab5-35eb-4cca-a780-dc0de7e827d6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:20.151547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:20.152291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.152565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.152833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.153481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:20.155123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.168418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 975/1936] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:20.172602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.183513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cd928-4884-49f7-8d98-bf90376dc99e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:20.188980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:20.189780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.194875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.194875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] PATH_INFO: `/v3/projects/699a232ce81b48aca736079f491b929f/users/9c4ed6e5109e49a8ae4ae4c1d7479cc6/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.222924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699a232ce81b48aca736079f491b929f, user_id=9c4ed6e5109e49a8ae4ae4c1d7479cc6, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:20.228386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.259049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:20.261915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf3781-2008-49cd-8f11-b6a5337e9b53 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.292085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 962/1937] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:20.353576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 976/1938] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:20 2022] PUT /identity/v3/projects/699a232ce81b48aca736079f491b929f/users/9c4ed6e5109e49a8ae4ae4c1d7479cc6/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:20.373952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.374823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.375106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.425129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] MFA Rules not processed for user `9c4ed6e5109e49a8ae4ae4c1d7479cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:20.425129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:20.614659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 963/1939] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:20.623689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.755077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf827fb-f155-4074-83fa-acbfa9425249 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:20.764415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:20.767959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:20.767959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:20.768238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:20.769422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:20.774044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:20.908218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 977/1940] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:20 2022] POST /identity/v3/projects => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:20.912737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:20.937673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22ba8b-02b7-40cd-a3a9-cc910fb5efe4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.083828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.084698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.085141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.085633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.086679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.089055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.220698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 964/1941] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:20 2022] POST /identity/v3/users => generated 292 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:21.222472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:21.241344 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00833e-d96d-4202-a649-d0fd609182eb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.250364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.251590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.252256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.252785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.253608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.255346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.258235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:21.273969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:21.276290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 978/1942] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:21.287654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a395a18-0bd1-4210-9bd2-13838579368e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.298970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.299950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.299950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.300310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] PATH_INFO: `/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9/users/935f676a23a64fbaaeb60fb0797f4670/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.324531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] RBAC: Authorizing `identity:create_grant(project_id=163524f94f014b1fbf6bab2fa2bf67a9, user_id=935f676a23a64fbaaeb60fb0797f4670, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.329653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.465953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 965/1943] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:21 2022] PUT /identity/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9/users/935f676a23a64fbaaeb60fb0797f4670/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:21.472461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:21.494442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d9a9-21ad-420a-bccc-fb874d18fc05 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.523301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:21.526882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:21.545022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:21.625704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.627222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.627862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.628542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.630070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.633622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.659831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 979/1944] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:21.665229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:21.677039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80078132-ad91-40b9-9b57-8320799addac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.688205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec805-d896-4b0b-a38c-dc7f03aca0ff admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:21.689943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.690764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.691234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.691610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] PATH_INFO: `/v3/users/577a9688129343d3ae61163a37ad8484` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.694090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577a9688129343d3ae61163a37ad8484)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.698685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:21.699406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.700248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.700886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.701634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] PATH_INFO: `/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9/users/935f676a23a64fbaaeb60fb0797f4670/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.705945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163524f94f014b1fbf6bab2fa2bf67a9, user_id=935f676a23a64fbaaeb60fb0797f4670, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:21.712448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c60254-cb22-4f18-bb52-5d8721603774 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:21.741270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 980/1945] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:21 2022] PUT /identity/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9/users/935f676a23a64fbaaeb60fb0797f4670/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:21.761814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:21.762306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:21.762790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:21.840141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] MFA Rules not processed for user `935f676a23a64fbaaeb60fb0797f4670`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:21.842591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:22.028728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 981/1946] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:22.053841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577a9688129343d3ae61163a37ad8484'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:22.098337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577a9688129343d3ae61163a37ad8484'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:22.206809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:22.221099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577a9688129343d3ae61163a37ad8484'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:22.229389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577a9688129343d3ae61163a37ad8484'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:22.255707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7073edd8-2236-45b7-9441-2c614b187a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577a9688129343d3ae61163a37ad8484'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:22.270088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 966/1947] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:21 2022] DELETE /identity/v3/users/577a9688129343d3ae61163a37ad8484 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:22.277635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:22.278429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:22.279093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:22.332329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dab159-054f-43d1-9d86-466fffa8bbe4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:22.341230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:22.349347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:22.379726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:22.477339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:22.478399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:22.480008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:22.480008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:22.486911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:22.501955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 967/1948] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:22.515677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:22.517712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:22.595628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:22.682040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be1c6-32e8-4941-8c51-73b1f6dcde33 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:22.696582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:22.697388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:22.699582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:22.699582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:22.714900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:22.716964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:22.730961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:22.744873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 968/1949] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:22.750291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:22.764705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 982/1950] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:23.570920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:23.579829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:23.589371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dd7a3-4e7e-4f32-bd52-48348fdabc1a service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:23.595730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:23.596450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:23.596770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:23.597046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] PATH_INFO: `/v3/projects/d83845559d3a453b865467e555e192df` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:23.598500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83845559d3a453b865467e555e192df)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:23.600616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:23.768978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83845559d3a453b865467e555e192df', 'request_id': 'req-5acce459-1e70-4fad-9c08-5debfd23c3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:23.796456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83845559d3a453b865467e555e192df', 'request_id': 'req-5acce459-1e70-4fad-9c08-5debfd23c3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:23.879548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83845559d3a453b865467e555e192df', 'request_id': 'req-5acce459-1e70-4fad-9c08-5debfd23c3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:23.925801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] The token cache is being invalidate because project d83845559d3a453b865467e555e192df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:23.928855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:23.931726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:23.947611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 969/1951] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:23 2022] DELETE /identity/v3/projects/d83845559d3a453b865467e555e192df => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:23.954395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:23.978693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88680c-65bb-41e1-afd8-93129c52eba2 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:24.134246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:24.135274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:24.135628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:24.135947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] PATH_INFO: `/v3/users/895e47fd65b34d59bec6847449522a23` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:24.137177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=895e47fd65b34d59bec6847449522a23)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:24.139140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:24.471488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895e47fd65b34d59bec6847449522a23'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:24.550997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895e47fd65b34d59bec6847449522a23'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:24.576782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895e47fd65b34d59bec6847449522a23'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:24.578838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895e47fd65b34d59bec6847449522a23'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:24.579614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895e47fd65b34d59bec6847449522a23'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:24.583014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:24.597956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 983/1952] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:23 2022] DELETE /identity/v3/users/895e47fd65b34d59bec6847449522a23 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:24.752611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:24.755019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:24.791820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acce459-1e70-4fad-9c08-5debfd23c3c9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:24.923749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:24.926302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:24.979939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:24.981225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:24.981505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:24.981777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] PATH_INFO: `/v3/users/e2bec50fdd9e4aca9400fbb23858e0b8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:24.985363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bec50fdd9e4aca9400fbb23858e0b8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:24.986887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:25.052822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033c0a2-5f3f-47f2-bafe-04403c894c1d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:25.059330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:25.060108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:25.061057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:25.061057 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] PATH_INFO: `/v3/users/9c4ed6e5109e49a8ae4ae4c1d7479cc6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:25.063515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4ed6e5109e49a8ae4ae4c1d7479cc6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:25.066506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:25.215365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bec50fdd9e4aca9400fbb23858e0b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.226093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:25.231472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bec50fdd9e4aca9400fbb23858e0b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.266074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4ed6e5109e49a8ae4ae4c1d7479cc6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.319480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bec50fdd9e4aca9400fbb23858e0b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.320658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bec50fdd9e4aca9400fbb23858e0b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.367395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7fc0929c-ae98-476e-b0aa-990cf66c68e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bec50fdd9e4aca9400fbb23858e0b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.383913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 970/1953] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:24 2022] DELETE /identity/v3/users/e2bec50fdd9e4aca9400fbb23858e0b8 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:25.387988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:25.387988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:25.388710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:25.410436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4ed6e5109e49a8ae4ae4c1d7479cc6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.438163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:25.440637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:25.455492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4ed6e5109e49a8ae4ae4c1d7479cc6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.457440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4ed6e5109e49a8ae4ae4c1d7479cc6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.459014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-24a9484a-6cd1-419e-a3bf-117aa618f85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4ed6e5109e49a8ae4ae4c1d7479cc6'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.560096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 984/1954] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:24 2022] DELETE /identity/v3/users/9c4ed6e5109e49a8ae4ae4c1d7479cc6 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:25.562975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:25.563460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:25.563977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:25.628034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 971/1955] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:25.633267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:25.634633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:25.636283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:25.636560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:25.654209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e33d8-f5b5-4b1c-a796-773e4b816971 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:25.742542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:25.743467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:25.744295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:25.744737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] PATH_INFO: `/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:25.753042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0690bb37ce48b8aa4605ce7130f8ce)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:25.755889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:25.786500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 985/1956] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:25.787482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:25.789657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:25.833544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:25.900586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077ee92-c217-4cea-be55-dd3a6f9de8d0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:25.906793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:25.908946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:25.909413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:25.909835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:25.931892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:25.934820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:25.938939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0690bb37ce48b8aa4605ce7130f8ce', 'request_id': 'req-144cc79f-7d5a-4856-9739-e390f9aaa8be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.951411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0690bb37ce48b8aa4605ce7130f8ce', 'request_id': 'req-144cc79f-7d5a-4856-9739-e390f9aaa8be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:25.955031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 986/1957] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:25.956311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:25.968144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c993-a846-46ad-b36e-01396a194708 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.069235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0690bb37ce48b8aa4605ce7130f8ce', 'request_id': 'req-144cc79f-7d5a-4856-9739-e390f9aaa8be'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:26.101049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] The token cache is being invalidate because project 3e0690bb37ce48b8aa4605ce7130f8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:26.101576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.102273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:26.102539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.102999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.103640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.104315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-144cc79f-7d5a-4856-9739-e390f9aaa8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:26.106484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:26.128993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 972/1958] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:25 2022] DELETE /identity/v3/projects/3e0690bb37ce48b8aa4605ce7130f8ce => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:26.140428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.141025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.146346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.178433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:26.181416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:26.206576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.208299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c018e-528b-462e-9aba-c889c59cadbf service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.219279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 987/1959] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:26.230239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:26.332755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 973/1960] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:26.343443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.343945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.344419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.382686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:26.384861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:26.399549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 988/1961] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:26.405290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.432930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5936051-afc0-4b46-97ef-7385a883316b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.442952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.444394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.444951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.445480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.446796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:26.447309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.450455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.480541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 974/1962] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:26.486526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.504282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9a7a-bd94-4c16-b5b6-0def92a48c20 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.515403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.516510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.516978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.517368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.518494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.522298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.637748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 989/1963] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:26 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:26.644944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.666613 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff66593-7dc1-4f96-a928-9fdfb5c65a98 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.786117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.787801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.788236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.788612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.792824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.792824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.838898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.841895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:26.884166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814a459-c036-4b74-b351-16cf6c5b5561 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.901980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.901980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.901980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.901980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] PATH_INFO: `/v3/projects/beb97837f0504514b2bac3e12b14b810` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.903151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb97837f0504514b2bac3e12b14b810)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.911734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.911924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 975/1964] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:26 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:26.913659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.929934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70068-ef99-4d9d-bcf0-6af046d3fb77 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:26.935181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:26.935827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:26.936124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:26.937369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:26.937881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:26.939712 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:26.958193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 976/1965] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:26.963665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:26.993409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379091-cee9-4d52-b612-cb63d46cc620 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:27.012074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:27.013185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.015260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.015260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.016343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:27.019507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:27.040683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 977/1966] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:27.048863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:27.075520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9eba-6b8b-4e67-a748-ebe5ca4e1248 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:27.084914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:27.086020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.086560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.087138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] PATH_INFO: `/v3/projects/eee7515c2107494f89718876798a4c82/users/7caf04d3a9fe420c8936b5d85d663659/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.106989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:27.132663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee7515c2107494f89718876798a4c82, user_id=7caf04d3a9fe420c8936b5d85d663659, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:27.135729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:27.144192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb97837f0504514b2bac3e12b14b810', 'request_id': 'req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.168912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb97837f0504514b2bac3e12b14b810', 'request_id': 'req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.241348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 978/1967] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:27 2022] PUT /identity/v3/projects/eee7515c2107494f89718876798a4c82/users/7caf04d3a9fe420c8936b5d85d663659/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:27.242296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:27.258454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:27.299871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb97837f0504514b2bac3e12b14b810', 'request_id': 'req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.334400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] The token cache is being invalidate because project beb97837f0504514b2bac3e12b14b810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:27.334995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.335676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:27.338723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ec2dcdb-97ac-4adc-863f-bd7cbc7fbbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.354133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 990/1968] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:26 2022] DELETE /identity/v3/projects/beb97837f0504514b2bac3e12b14b810 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:27.372054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.372054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.372054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.424125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] MFA Rules not processed for user `7caf04d3a9fe420c8936b5d85d663659`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:27.426047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:27.438025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91645b5-4aa1-4d88-8567-899772ab6eb2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:27.449123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:27.450585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.450955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.451438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] PATH_INFO: `/v3/projects/699a232ce81b48aca736079f491b929f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.453662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=699a232ce81b48aca736079f491b929f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:27.457035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:27.569775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 991/1969] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:27.571399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:27.584719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:27.612416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0b26a-f452-4706-8990-004cb42846b1 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:27.626549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:27.627379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.627733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.628044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] PATH_INFO: `/v3/users/387b9039b89f4d4b84d62ed183b841a7` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.629392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] RBAC: Authorizing `identity:delete_user(user_id=387b9039b89f4d4b84d62ed183b841a7)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:27.631496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:27.659618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699a232ce81b48aca736079f491b929f', 'request_id': 'req-881d682c-6a1f-48c9-be4c-909dfbcc44fb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.671985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699a232ce81b48aca736079f491b929f', 'request_id': 'req-881d682c-6a1f-48c9-be4c-909dfbcc44fb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.802872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699a232ce81b48aca736079f491b929f', 'request_id': 'req-881d682c-6a1f-48c9-be4c-909dfbcc44fb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.824238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] The token cache is being invalidate because project 699a232ce81b48aca736079f491b929f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:27.824755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.826108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.829170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 979/1970] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:27 2022] DELETE /identity/v3/projects/699a232ce81b48aca736079f491b929f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:27.830841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:27.838943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:27.884750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387b9039b89f4d4b84d62ed183b841a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.934999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d682c-6a1f-48c9-be4c-909dfbcc44fb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:27.941929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:27.942770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:27.943090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:27.943425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:27.945804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:27.957949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387b9039b89f4d4b84d62ed183b841a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.979964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387b9039b89f4d4b84d62ed183b841a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.981436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387b9039b89f4d4b84d62ed183b841a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:27.982459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387b9039b89f4d4b84d62ed183b841a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.005546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 992/1971] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:27 2022] DELETE /identity/v3/users/387b9039b89f4d4b84d62ed183b841a7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:28.007434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:28.031023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:28.049135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:28.052772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:28.074381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 980/1972] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:28.104404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:28.109094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:28.111162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:28.147606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:28.218489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14bce0-8a3b-41bf-8b8d-4fb1936a771b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:28.231699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:28.232577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:28.232963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:28.234277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] PATH_INFO: `/v3/users/935f676a23a64fbaaeb60fb0797f4670` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:28.236219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935f676a23a64fbaaeb60fb0797f4670)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:28.240091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b30d3-8ea7-4e15-a380-bef780881ab5 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:28.245454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:28.252264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:28.253011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:28.253499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:28.254170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] PATH_INFO: `/v3/users/7caf04d3a9fe420c8936b5d85d663659` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:28.256539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caf04d3a9fe420c8936b5d85d663659)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:28.260551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:28.556982 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caf04d3a9fe420c8936b5d85d663659'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.570982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935f676a23a64fbaaeb60fb0797f4670'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.579127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caf04d3a9fe420c8936b5d85d663659'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.654117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935f676a23a64fbaaeb60fb0797f4670'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.699435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935f676a23a64fbaaeb60fb0797f4670'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.701034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935f676a23a64fbaaeb60fb0797f4670'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.702744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0e3fc85b-fd96-40a4-b316-74940f177341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935f676a23a64fbaaeb60fb0797f4670'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.728698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 993/1973] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:28 2022] DELETE /identity/v3/users/935f676a23a64fbaaeb60fb0797f4670 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:28.745700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caf04d3a9fe420c8936b5d85d663659'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.746996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caf04d3a9fe420c8936b5d85d663659'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.880872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caf04d3a9fe420c8936b5d85d663659'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:28.899027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:28.899875 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:28.900413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:28.901828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 981/1974] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:28 2022] DELETE /identity/v3/users/7caf04d3a9fe420c8936b5d85d663659 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:28.950273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:28.954538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:29.123542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 994/1975] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:29.142614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:29.144388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:29.193447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:29.196133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:29.248080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91298bbf-3d21-4c1a-8556-aa56b59f4624 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:29.266143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:29.268752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.268752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.269063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] PATH_INFO: `/v3/projects/4238e90e8bd74b7d8f624d21db260970` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.270451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4238e90e8bd74b7d8f624d21db260970)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:29.272418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:29.318555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8208c46-3cdc-44ff-b3ab-9bd408c443ac admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:29.328082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:29.329567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.330327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.331060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.346409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:29.348612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056acf5-2dd3-4330-bc33-daa833cc1a03 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:29.369446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 982/1976] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:29.482960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:29.506644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4238e90e8bd74b7d8f624d21db260970', 'request_id': 'req-d2dbb086-de98-4869-bb1b-e43d1d1ac742'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:29.522267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4238e90e8bd74b7d8f624d21db260970', 'request_id': 'req-d2dbb086-de98-4869-bb1b-e43d1d1ac742'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:29.603388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4238e90e8bd74b7d8f624d21db260970', 'request_id': 'req-d2dbb086-de98-4869-bb1b-e43d1d1ac742'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:29.652954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] The token cache is being invalidate because project 4238e90e8bd74b7d8f624d21db260970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:29.653399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:29.654460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d2dbb086-de98-4869-bb1b-e43d1d1ac742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:29.658208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 995/1977] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:29 2022] DELETE /identity/v3/projects/4238e90e8bd74b7d8f624d21db260970 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:29.665991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.666460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.666835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.695824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:29.697052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:29.755994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:29.805032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 983/1978] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:29.819326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.819954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.820632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.854786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:29.856076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:29.874336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 996/1979] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:29.876222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:29.890020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84452c-445f-49b8-8926-fccd616dd54d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:29.898189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:29.899222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.899596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.899947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.900676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:29.901004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:29.907201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:29.925310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 984/1980] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:29.926936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:29.948628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff33f8d-4907-4700-870b-b18c44181521 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:29.957675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:29.959090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:29.960524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:29.961097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:29.962671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:29.965838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.098950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 997/1981] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:29 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:30.105480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.129110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0806c7-de46-449f-99a5-f120fa1d27f0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.284245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.285405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.285828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.286239 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.287529 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.290143 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.438981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.442599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:30.461201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 985/1982] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:30 2022] POST /identity/v3/users => generated 290 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:30.467633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.491621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6c293-789c-46cf-a45e-c29c213a3461 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.493097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cb0ae-0f6a-430b-8f13-761f8254c1be admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.502202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.502514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.503487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.503992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.504466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] PATH_INFO: `/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.505886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.506479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163524f94f014b1fbf6bab2fa2bf67a9)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.507053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.507722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.509072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.510214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.512656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.538824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 986/1983] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:30.543517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.566072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e93-b2bf-4540-8e9f-73bc35ce5d2f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.579208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.580615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.581328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.582052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.583249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.586602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.614160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 987/1984] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:30.615924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.646783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221447-1887-46cb-96f7-ea91966b3851 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.673831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.675002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.675330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.675610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] PATH_INFO: `/v3/projects/3271ee1c6a2b40bc86bdad8a230941d9/users/b76b2043c12c4335949e4da94535ab85/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.700970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3271ee1c6a2b40bc86bdad8a230941d9, user_id=b76b2043c12c4335949e4da94535ab85, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.706312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.733679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163524f94f014b1fbf6bab2fa2bf67a9', 'request_id': 'req-bef78700-1d2c-41af-a652-93a820885b77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:30.760088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163524f94f014b1fbf6bab2fa2bf67a9', 'request_id': 'req-bef78700-1d2c-41af-a652-93a820885b77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:30.793885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 988/1985] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:30 2022] PUT /identity/v3/projects/3271ee1c6a2b40bc86bdad8a230941d9/users/b76b2043c12c4335949e4da94535ab85/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:30.795365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:30.809354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:30.844425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163524f94f014b1fbf6bab2fa2bf67a9', 'request_id': 'req-bef78700-1d2c-41af-a652-93a820885b77'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:30.871359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] The token cache is being invalidate because project 163524f94f014b1fbf6bab2fa2bf67a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:30.871640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:30.872746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-bef78700-1d2c-41af-a652-93a820885b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:30.875395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 998/1986] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:30 2022] DELETE /identity/v3/projects/163524f94f014b1fbf6bab2fa2bf67a9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:30.876808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfca4-54cf-4286-bfa7-c42fe0d3597e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.877087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfca4-54cf-4286-bfa7-c42fe0d3597e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.877519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dfca4-54cf-4286-bfa7-c42fe0d3597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.918846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2222-bd15-4029-bf53-b05740407ec3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:30.926533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:30.927231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:30.927520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:30.927959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] PATH_INFO: `/v3/projects/eee7515c2107494f89718876798a4c82` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:30.935220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee7515c2107494f89718876798a4c82)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:30.935220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:30.937230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-722dfca4-54cf-4286-bfa7-c42fe0d3597e None None] MFA Rules not processed for user `b76b2043c12c4335949e4da94535ab85`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:30.938619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-722dfca4-54cf-4286-bfa7-c42fe0d3597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:30.949677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:31.033329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 999/1987] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:31.034835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.035225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.035586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.055682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:31.064920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:31.070384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.098245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee7515c2107494f89718876798a4c82', 'request_id': 'req-e12c7939-6014-433d-ab04-7705fdc5a7d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:31.109889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee7515c2107494f89718876798a4c82', 'request_id': 'req-e12c7939-6014-433d-ab04-7705fdc5a7d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:31.167192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee7515c2107494f89718876798a4c82', 'request_id': 'req-e12c7939-6014-433d-ab04-7705fdc5a7d1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:31.169200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1000/1988] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:31.173040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.182257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.185388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] The token cache is being invalidate because project eee7515c2107494f89718876798a4c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:31.185752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:31.186804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e12c7939-6014-433d-ab04-7705fdc5a7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:31.193320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 989/1989] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:30 2022] DELETE /identity/v3/projects/eee7515c2107494f89718876798a4c82 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:31.195662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9677-5ca4-4990-af70-893cb4bc697b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.196360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9677-5ca4-4990-af70-893cb4bc697b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.196817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d9677-5ca4-4990-af70-893cb4bc697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.203160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee6fd-494d-4375-b23d-72f1e5f63f39 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.209248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.210124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.210619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.211031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.212297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.214883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.233317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4c8d9677-5ca4-4990-af70-893cb4bc697b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:31.237156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c8d9677-5ca4-4990-af70-893cb4bc697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.254556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 990/1990] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:31.256879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.265937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.266480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.290774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:31.292054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.302139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 991/1991] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:31.303093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.319028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47992da-2c49-4fdf-9c8e-354658454038 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.324251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.324827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.325102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.325372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.338448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:31.338448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.338448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051db3f1-94bc-4f7c-8dc4-5094c3052b18 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.342006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 992/1992] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:31.343429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.343948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.344227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.369711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1001/1993] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:31.371680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.374717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:31.376592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.493118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 993/1994] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:31.493118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.495433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:31.508967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50601e69-9c45-4283-9b12-f81b21e958a4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.516386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.518232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.518415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.518564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.519299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.522124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.523988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0fd9e-25b6-4166-87a1-bd89ba4c704f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.529305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.530609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.530892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.531324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.533659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.534032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.642980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 994/1995] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:31.647129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.649779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1002/1996] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:31.651399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.670240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c37a-1fe9-4614-9629-5404fb028a8f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.866624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6504-f3ca-45a9-8959-f0f6e0a1cdcd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.876526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.877825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.879288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.880813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.882209 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.884463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.900687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:31.909385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1003/1997] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:31.913631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.917845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.919363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.920382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.921657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.923128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:31.923669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.928568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.937321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ac17-b250-41cc-89cc-371077281d86 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:31.948334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:31.949475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:31.949884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:31.950348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:31.951546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:31.957129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:31.974756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:31.979848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 995/1998] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:31.979848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:31.998232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8d3b8-9a1b-4c3a-9c54-abe67ebd13d0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.007568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.007568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.007568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.007568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.008195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.009461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.022121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 996/1999] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:32.023225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.044551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18601e6c-afe1-4c90-a04e-1c0ea8e4bd75 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.051200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.051958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.052238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.052512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.053312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.055215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.096385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1004/2000] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:31 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:32.098250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.115687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915b708-e1bc-4ebe-afee-c2eedb1f199f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.122255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.123297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.123852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.124214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] PATH_INFO: `/v3/projects/02dc90bee9eb4eb99726521e27824e78/users/21ad768e16834b8e9efa22e6352911d0/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.149261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dc90bee9eb4eb99726521e27824e78, user_id=21ad768e16834b8e9efa22e6352911d0, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.154727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.174061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 997/2001] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:32.175065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.264070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1005/2002] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:32 2022] PUT /identity/v3/projects/02dc90bee9eb4eb99726521e27824e78/users/21ad768e16834b8e9efa22e6352911d0/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:32.279167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.288655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943274-4f9a-4857-942e-764e2cded0ec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.386672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c702f-d3b0-4819-9733-2f855ab1091e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.392165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.393089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.393525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.393898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.394258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.394876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.395116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.395290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.395439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.396065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.397785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012959-773f-419d-ac72-e3a78a81dcd5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.398178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.410277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 998/2003] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:32.411576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.411952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.412148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.465498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] MFA Rules not processed for user `21ad768e16834b8e9efa22e6352911d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:32.467663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:32.516066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1006/2004] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:32.522484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.540728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedcb0-3619-4a20-8520-b949963d5aa5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.549312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.549992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.550268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.550543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.551196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.553086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.563260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:32.569186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1007/2005] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:32.569186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.581814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 999/2006] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:32.582381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218e26-bf71-4d99-98cc-d023f985135b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.583606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.589115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.589754 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.590033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.590316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.591006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.593711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.606524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1008/2007] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:32.611384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed91bd-6b1a-412e-9391-83f303e502d9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.611549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.618038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.619422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.619884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.620288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] PATH_INFO: `/v3/projects/3523f51848a14885a5f1a9799b88a7a7/users/35224385c28d4e52aaf805c25367387b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.627339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd239b0-ebd1-4f92-866e-80a707ec3adf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.633346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.639977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.639977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.639977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.639977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.639977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb672b-a24c-4ec2-8d1e-34391c0096db admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.652282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3523f51848a14885a5f1a9799b88a7a7, user_id=35224385c28d4e52aaf805c25367387b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.659560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.753257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1000/2008] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:32 2022] PUT /identity/v3/projects/3523f51848a14885a5f1a9799b88a7a7/users/35224385c28d4e52aaf805c25367387b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:32.754986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.782813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1009/2009] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:32.784491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.785108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.785449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.831463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d6a2-4649-4fc8-8202-3f4a885bb3a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.832290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] MFA Rules not processed for user `35224385c28d4e52aaf805c25367387b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:32.833593 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:32.920763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.921641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.922118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.923411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.923847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.927159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.930672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:32.941439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1010/2010] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:32.946260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.950227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1001/2011] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:32.950227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:32.963041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f04e57-01d5-438d-8c37-f4d6fd6b4031 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.966136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f96a4-c27e-42b9-a3d3-1196755231b2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:32.969860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.970550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.970888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.971285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.972297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.974579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:32.974927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:32.975541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:32.976501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:32.976501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:32.977676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:32.981218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.097638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1011/2012] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:33.098879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.119962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfc740-86dd-41ee-b135-e60628512ed8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.126678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.127381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.127645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.128000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] PATH_INFO: `/v3/projects/f15b938653c644f8a90a5668a6665b36/users/89bb70a2d4d5482f8e44caa96e060e75/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.132543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1002/2013] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:32 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:33.144218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.159513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15b938653c644f8a90a5668a6665b36, user_id=89bb70a2d4d5482f8e44caa96e060e75, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.165406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.232870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:33.262173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1012/2014] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:33 2022] PUT /identity/v3/projects/f15b938653c644f8a90a5668a6665b36/users/89bb70a2d4d5482f8e44caa96e060e75/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:33.263668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.291605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7635b6-71c4-4be2-849e-acf9de5b6128 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.376749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057bf53-ad54-4a9c-9bef-90f363b48486 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.408415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.410094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.410539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.410965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.412317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.415241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.490827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.491940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.492429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.492937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.494310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.497113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2066cf4-54d9-49b8-b7aa-680702ca2006 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.510688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1003/2015] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:33.512721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.513147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.514949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.565686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1013/2016] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:33 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:33.566463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] MFA Rules not processed for user `89bb70a2d4d5482f8e44caa96e060e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:33.566614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.566758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:33.599249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745b3d-4af8-4c88-b3fe-667de1980b87 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.599249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.599249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.599249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.601612 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] PATH_INFO: `/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d/users/2ce12e1b66db46a2a9ae9e8e7b1f0004/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.628899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f9dc569b6d4d0e96b04ff2d5641d7d, user_id=2ce12e1b66db46a2a9ae9e8e7b1f0004, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.635030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.676476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1004/2017] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:33.677665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.694809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091af69e-36db-4a0b-9d2d-ac0ef629ca02 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.700407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.701026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.701305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.701571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.702284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.703913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.716642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1005/2018] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:33.718115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.720699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:33.763607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1014/2019] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:33 2022] PUT /identity/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d/users/2ce12e1b66db46a2a9ae9e8e7b1f0004/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:33.765262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.872144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1db11-6871-48c3-99ec-7cd9a639ffcf admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.878274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.879237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.879641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.880317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] PATH_INFO: `/v3/projects/ad4017442b3349d4b2684b6208699f41/users/2454b8073fd7432d9ccf2ec53e44d70d/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.901977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4017442b3349d4b2684b6208699f41, user_id=2454b8073fd7432d9ccf2ec53e44d70d, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:33.906659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:33.912409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1ea5-3844-4f25-b2f4-898ffc4807c7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:33.919058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:33.968407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1015/2020] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:33 2022] PUT /identity/v3/projects/ad4017442b3349d4b2684b6208699f41/users/2454b8073fd7432d9ccf2ec53e44d70d/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:33.969817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:33.980880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:33.983468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:33.984225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:33.984716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:33.988914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:34.071972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2dc4c-80c0-4a8e-9ca4-62e3a967ff11 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.073010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.074743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.078479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.079113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.079400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.079738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.080387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.082065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.088625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1006/2021] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:34.090036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:34.096822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1016/2022] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:34.106190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:34.108771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba36a-d0b3-41e5-a4ba-c8a7a1707780 service glance] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.117065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.118126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.118704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.119980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.122077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.125282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.127169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef17a-f6e6-4d8d-bcb1-6f1f6255f50b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.136865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.136865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.136865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.136865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] PATH_INFO: `/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d/users/2ce12e1b66db46a2a9ae9e8e7b1f0004/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.138082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1007/2023] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:34.140303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f9dc569b6d4d0e96b04ff2d5641d7d, user_id=2ce12e1b66db46a2a9ae9e8e7b1f0004, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.142557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:34.145109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40fbd-8653-4231-9bab-da7013e8af3f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.153341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b61a-a446-4dcf-8377-cc9fe02c7dd7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.161491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1017/2024] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:34 2022] PUT /identity/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d/users/2ce12e1b66db46a2a9ae9e8e7b1f0004/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:34.178870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.179181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.179522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.222322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] MFA Rules not processed for user `2ce12e1b66db46a2a9ae9e8e7b1f0004`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:34.224039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:34.234501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.236164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.236840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.237689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] PATH_INFO: `/v3/projects/ad4017442b3349d4b2684b6208699f41/users/2454b8073fd7432d9ccf2ec53e44d70d/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.243097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4017442b3349d4b2684b6208699f41, user_id=2454b8073fd7432d9ccf2ec53e44d70d, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.248166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43321b-576c-4d72-84ec-1919d5c83e5b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.284711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1008/2025] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:34 2022] PUT /identity/v3/projects/ad4017442b3349d4b2684b6208699f41/users/2454b8073fd7432d9ccf2ec53e44d70d/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:34.301727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.302222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.302721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.338797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] MFA Rules not processed for user `2454b8073fd7432d9ccf2ec53e44d70d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:34.340223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:34.364862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1018/2026] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:34.383540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:34.386069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:34.410896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:34.490519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1009/2027] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:34.525502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb110-fa83-4b5e-9de3-5cdf52a3e8e3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.572464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:34.598584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.599140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.599427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.599698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.703670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.707395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.721547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1019/2028] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:34.901445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:34.918537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799b4d-254e-454c-b98a-0b93cc9e7116 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:34.925125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:34.926142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:34.926636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:34.927107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:34.943266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:34.946034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:34.965210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1010/2029] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:35.153731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:35.168149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643f25-481a-4f3d-9245-0a6a7b3fafe7 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:35.174592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:35.175572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:35.176065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:35.176543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:35.179630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:35.268935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:35.270573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:35.282331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1020/2030] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:40.543702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:40.669379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e4156-baaf-4c6b-9217-8785c09aeab8 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:40.685425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:40.687129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:40.687674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:40.690778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] PATH_INFO: `/v3/users/35224385c28d4e52aaf805c25367387b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:40.691923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35224385c28d4e52aaf805c25367387b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:40.696222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:40.995792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35224385c28d4e52aaf805c25367387b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.009210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35224385c28d4e52aaf805c25367387b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.067173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:41.069410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.089512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122ba4-d38e-45da-b942-b583de39b4ce service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:41.100003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:41.103162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.103956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.104651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] PATH_INFO: `/v3/users/4e2f70d07a614ecea11098daf28e8116` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.107040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2f70d07a614ecea11098daf28e8116)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:41.112048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:41.147720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35224385c28d4e52aaf805c25367387b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.149462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35224385c28d4e52aaf805c25367387b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.207221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-efcde502-4a6b-47be-ad4d-5c44fbe86849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35224385c28d4e52aaf805c25367387b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.226594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1011/2031] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:40 2022] DELETE /identity/v3/users/35224385c28d4e52aaf805c25367387b => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:41.234138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.236151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.236990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.294608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:41.298797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.382147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:41.421174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1012/2032] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:41.434299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2f70d07a614ecea11098daf28e8116'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.450044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:41.454108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.569761 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2f70d07a614ecea11098daf28e8116'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.579557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c15bd-26db-4ea5-bfdb-122339456859 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:41.588869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2f70d07a614ecea11098daf28e8116'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.589895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2f70d07a614ecea11098daf28e8116'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.590869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8a669ad-90d3-4d02-892e-e77ce1297375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2f70d07a614ecea11098daf28e8116'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:41.592064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:41.593817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.594349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.594767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.597291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.613041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:41.637810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:41.641753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1021/2033] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:41 2022] DELETE /identity/v3/users/4e2f70d07a614ecea11098daf28e8116 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:41.642503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab387-ee04-485c-9e1b-c8dce5d78a37 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:41.650544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.651255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.651744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.668383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1013/2034] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:41.680752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:41.682307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.733428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b901c8-5ac4-425b-9143-bd347ef7272e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.734260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b901c8-5ac4-425b-9143-bd347ef7272e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.735029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b901c8-5ac4-425b-9143-bd347ef7272e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.739082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1014/2035] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:21:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:21:41.756573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:41.757219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:41.758369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:41.793921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] MFA Rules not processed for user `48609f3d5dd94c5a9cf3fc0e18bf0aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:41.796455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.837122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1022/2036] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:41.853859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:41.855850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.948599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1015/2037] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:41.949924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:41.953416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:41.981760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede038ff-abde-43a0-a692-d463c6a2cce2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.003654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.004983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.006221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.007107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] PATH_INFO: `/v3/users/83f8f08f77bc4ed49311feab7aa31263` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.010600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f8f08f77bc4ed49311feab7aa31263)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.015161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:42.036954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d016-d450-459b-a117-9586b37a6f8c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.041836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.042887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.043408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.043986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.059424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.061860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:42.073778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1023/2038] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:42.074800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:42.076403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:42.094545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff8e0b-fe3a-46be-9472-e6fcd6cc4e9e service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.102085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.103117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.103480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.103776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.115062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.116786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:42.129093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1024/2039] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:42.263627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:42.269468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:42.290143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f6fd-2c21-4d62-b667-65e57d6f19d8 service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.298274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.299323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.299702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.304538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] PATH_INFO: `/v3/users/b76b2043c12c4335949e4da94535ab85` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.304538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76b2043c12c4335949e4da94535ab85)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.310384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:42.413406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f8f08f77bc4ed49311feab7aa31263'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.432768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f8f08f77bc4ed49311feab7aa31263'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.528958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f8f08f77bc4ed49311feab7aa31263'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.532072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f8f08f77bc4ed49311feab7aa31263'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.549025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:42.561567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f8f08f77bc4ed49311feab7aa31263'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.577643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1016/2040] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:41 2022] DELETE /identity/v3/users/83f8f08f77bc4ed49311feab7aa31263 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:42.606400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76b2043c12c4335949e4da94535ab85'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.632650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:42.640587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:42.696496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76b2043c12c4335949e4da94535ab85'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.715677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76b2043c12c4335949e4da94535ab85'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.716511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76b2043c12c4335949e4da94535ab85'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.717780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76b2043c12c4335949e4da94535ab85'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:42.725673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:42.759669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1025/2041] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:42 2022] DELETE /identity/v3/users/b76b2043c12c4335949e4da94535ab85 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:42.765716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:42.777014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:42.787577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf12a-cb98-46e8-b8da-94bf72fe821f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.881810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.882686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.883030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.883397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] PATH_INFO: `/v3/projects/3523f51848a14885a5f1a9799b88a7a7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.884691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3523f51848a14885a5f1a9799b88a7a7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.886687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:42.909038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b3d9-8016-4909-b685-2f940cb10cf2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:42.914259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:42.914924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:42.915198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:42.915460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] PATH_INFO: `/v3/projects/7908a2cf56bb4adeb60cb0769e56dd52` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:42.917368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7908a2cf56bb4adeb60cb0769e56dd52)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:42.920510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:43.073592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7908a2cf56bb4adeb60cb0769e56dd52', 'request_id': 'req-48181f99-2f2a-454d-9969-5046c42006b9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.076149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3523f51848a14885a5f1a9799b88a7a7', 'request_id': 'req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.086878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7908a2cf56bb4adeb60cb0769e56dd52', 'request_id': 'req-48181f99-2f2a-454d-9969-5046c42006b9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.089430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3523f51848a14885a5f1a9799b88a7a7', 'request_id': 'req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.240693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7908a2cf56bb4adeb60cb0769e56dd52', 'request_id': 'req-48181f99-2f2a-454d-9969-5046c42006b9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.253507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] The token cache is being invalidate because project 7908a2cf56bb4adeb60cb0769e56dd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:43.253799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.254607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-48181f99-2f2a-454d-9969-5046c42006b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.256205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1026/2042] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:42 2022] DELETE /identity/v3/projects/7908a2cf56bb4adeb60cb0769e56dd52 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:43.257485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:43.257763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:43.258041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:43.283527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:43.285704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:43.341417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3523f51848a14885a5f1a9799b88a7a7', 'request_id': 'req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.359141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] The token cache is being invalidate because project 3523f51848a14885a5f1a9799b88a7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:43.359660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.360552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.363522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1017/2043] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:42 2022] DELETE /identity/v3/projects/3523f51848a14885a5f1a9799b88a7a7 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:43.364434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:43.368114 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:43.377409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1027/2044] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:43.378377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:43.380089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:43.394648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351cd2-a64d-4a27-8c3c-9b003a508eab None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:43.399350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc9a5b-763a-4a52-92df-c3536ff4ed54 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:43.404212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:43.405248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:43.406066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:43.406303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:43.406303 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:43.406595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:43.406748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] PATH_INFO: `/v3/users/8c0bd80d6ffd45a4b4a2d91c5d45822d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:43.406901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] PATH_INFO: `/v3/projects/b14abd0da6554b4aa4ce73daadb45d7f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:43.407650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0bd80d6ffd45a4b4a2d91c5d45822d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:43.409253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14abd0da6554b4aa4ce73daadb45d7f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:43.409763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:43.412576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:43.441129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:43.621419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0bd80d6ffd45a4b4a2d91c5d45822d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.625941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14abd0da6554b4aa4ce73daadb45d7f', 'request_id': 'req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.636794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14abd0da6554b4aa4ce73daadb45d7f', 'request_id': 'req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.741357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0bd80d6ffd45a4b4a2d91c5d45822d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.763121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0bd80d6ffd45a4b4a2d91c5d45822d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.764656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0bd80d6ffd45a4b4a2d91c5d45822d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.765475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0bd80d6ffd45a4b4a2d91c5d45822d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.770603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:43.782449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1028/2045] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:43 2022] DELETE /identity/v3/users/8c0bd80d6ffd45a4b4a2d91c5d45822d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:43.784169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:43.792274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:43.798256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14abd0da6554b4aa4ce73daadb45d7f', 'request_id': 'req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.814700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] The token cache is being invalidate because project b14abd0da6554b4aa4ce73daadb45d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:43.815157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.818541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:43.827123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1018/2046] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:43 2022] DELETE /identity/v3/projects/b14abd0da6554b4aa4ce73daadb45d7f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:43.829240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:43.831808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:43.937677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6397-ccca-4c7c-a3de-821f9a2c64b9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:43.946237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:43.947312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:43.947859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:43.948395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] PATH_INFO: `/v3/users/2454b8073fd7432d9ccf2ec53e44d70d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:43.950637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2454b8073fd7432d9ccf2ec53e44d70d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:43.953685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:43.966455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd953-5eee-4ef5-af21-bac26fc6c08b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.069370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:44.070968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.071481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.072020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.075339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.097485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:44.108382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6210b-3453-43c3-a3e3-a89381e12538 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:44.117511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1019/2047] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:44.128834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c65d-5e74-49b4-9d5d-850b117aaf6c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.131166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c65d-5e74-49b4-9d5d-850b117aaf6c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.131709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680c65d-5e74-49b4-9d5d-850b117aaf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.178744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4680c65d-5e74-49b4-9d5d-850b117aaf6c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:44.180046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4680c65d-5e74-49b4-9d5d-850b117aaf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.189900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1020/2048] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:44.198990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.198990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.198990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.228649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:44.231365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.251610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1021/2049] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:44.256566 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:44.275226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b24864-3390-4bea-b00e-c877803fa801 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.286727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2454b8073fd7432d9ccf2ec53e44d70d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.287604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:44.289314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.289892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.290508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.291716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:44.292392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:44.295313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:44.316775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1022/2050] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:21:44.323656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:44.336296 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f2ade-158c-461e-b3da-6cae1ad3da4c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.341622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:44.343041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.343041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.343724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.344522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:44.346635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:44.511063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2454b8073fd7432d9ccf2ec53e44d70d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.539987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2454b8073fd7432d9ccf2ec53e44d70d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.539987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2454b8073fd7432d9ccf2ec53e44d70d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.539987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2454b8073fd7432d9ccf2ec53e44d70d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.556261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1029/2051] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:43 2022] DELETE /identity/v3/users/2454b8073fd7432d9ccf2ec53e44d70d => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:44.560299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:44.562475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.613771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1023/2052] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:44 2022] POST /identity/v3/projects => generated 389 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:44.619667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:44.623891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.649601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b71f-4606-4f9c-8ad3-c76fb8c26431 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.782450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:44.783872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.784680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.785201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] PATH_INFO: `/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.786126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47404e-49ab-49c4-b088-1c6b8fb6f1ca admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.787194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=431cff8657ef4fdba2ca58ecf3bab1e0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:44.790964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:44.793658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:44.794637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:44.795054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:44.796071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:44.797151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:44.800703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:44.867249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:44.907586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1024/2053] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:44 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:44.911919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:44.915061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:44.932133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431cff8657ef4fdba2ca58ecf3bab1e0', 'request_id': 'req-06b22384-0195-4301-942c-a62e4cafaf7d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:44.932856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678061c-c0a1-4ba6-8011-6db5cea63b30 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:44.943586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431cff8657ef4fdba2ca58ecf3bab1e0', 'request_id': 'req-06b22384-0195-4301-942c-a62e4cafaf7d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.033623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431cff8657ef4fdba2ca58ecf3bab1e0', 'request_id': 'req-06b22384-0195-4301-942c-a62e4cafaf7d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.033893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.034793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.035278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.035687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] PATH_INFO: `/v3/projects/3271ee1c6a2b40bc86bdad8a230941d9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.037903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3271ee1c6a2b40bc86bdad8a230941d9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.041601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.052751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] The token cache is being invalidate because project 431cff8657ef4fdba2ca58ecf3bab1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:45.052751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.054235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.056196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1030/2054] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:44 2022] DELETE /identity/v3/projects/431cff8657ef4fdba2ca58ecf3bab1e0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:45.060692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.064007 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.087471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:45.096252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22384-0195-4301-942c-a62e4cafaf7d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.102472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.103277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.103877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.104615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.105586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.108187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fda71-1829-4674-83cb-66e0dc6d5bb2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.127025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1031/2055] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:45.128749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.129061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.129308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.155110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:45.157176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.170942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1032/2056] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:45.172049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.194578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373718d2-0c99-40c4-b2d8-1d3a50aa486c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.194578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.194578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.194578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.194978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.195559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.197285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d69e7-3719-419d-8d98-62f50c07a82d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.218659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1033/2057] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:45.221364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.223155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.223155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.267102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:45.268784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.287803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3271ee1c6a2b40bc86bdad8a230941d9', 'request_id': 'req-f996a668-15ec-4eb6-b355-e97df72b7fc9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.298814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3271ee1c6a2b40bc86bdad8a230941d9', 'request_id': 'req-f996a668-15ec-4eb6-b355-e97df72b7fc9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.391137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1034/2058] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:45.396226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.402368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea72fbb-fc61-4cb2-9696-2b2ad9c5110b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.407239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.408014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.408355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.408556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] PATH_INFO: `/v3/projects/d2e649efab714436a9ded73cc61e3186/users/53d8816f0b3a4cb1a9da6dc11428b514/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.426704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e649efab714436a9ded73cc61e3186, user_id=53d8816f0b3a4cb1a9da6dc11428b514, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.429625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.436966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3271ee1c6a2b40bc86bdad8a230941d9', 'request_id': 'req-f996a668-15ec-4eb6-b355-e97df72b7fc9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.463309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] The token cache is being invalidate because project 3271ee1c6a2b40bc86bdad8a230941d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:45.463810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.464734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.466628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1025/2059] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:44 2022] DELETE /identity/v3/projects/3271ee1c6a2b40bc86bdad8a230941d9 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:45.467964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.469264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.485204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a668-15ec-4eb6-b355-e97df72b7fc9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.491552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.492404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.492678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.492949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] PATH_INFO: `/v3/projects/ad4017442b3349d4b2684b6208699f41` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.494403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4017442b3349d4b2684b6208699f41)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.496407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.516995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1035/2060] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:45 2022] PUT /identity/v3/projects/d2e649efab714436a9ded73cc61e3186/users/53d8816f0b3a4cb1a9da6dc11428b514/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:45.524523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.527215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.640546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac21bf-0da8-400b-a9ef-e923265fa1c0 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.657686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4017442b3349d4b2684b6208699f41', 'request_id': 'req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.669112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4017442b3349d4b2684b6208699f41', 'request_id': 'req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.741379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.742065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.742543 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.742811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.743475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:45.743832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.745926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.761736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1036/2061] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:45.769169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.773994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.790781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f459b-cf6e-4d06-bf4e-832737cdcaf2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.793186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4017442b3349d4b2684b6208699f41', 'request_id': 'req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.797604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.798259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.798547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.798815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] PATH_INFO: `/v3/users/21ad768e16834b8e9efa22e6352911d0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.803149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ad768e16834b8e9efa22e6352911d0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.804718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:45.813286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] The token cache is being invalidate because project ad4017442b3349d4b2684b6208699f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:45.813618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.814357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b69b3aaf-58b8-49ba-ab33-73e5a292fc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:45.816131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1026/2062] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:45 2022] DELETE /identity/v3/projects/ad4017442b3349d4b2684b6208699f41 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:45.817619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.817907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.818186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.839132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:45.840340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.849770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1027/2063] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:45.850703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:45.852414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:45.865747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ccfe6-ebb9-42a2-9375-ad26a862af43 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:45.871590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:45.872251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:45.872528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:45.872799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:45.873466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:45.875535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2477e-6a98-4ef1-ae50-23393afaa920 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.002375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1028/2064] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:45 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:46.004696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.005069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.005472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.036003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:46.037605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:46.071274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ad768e16834b8e9efa22e6352911d0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:46.086253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:46.130961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1029/2065] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:46.132375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.144861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:46.210777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:46.236585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318c07e-ed22-416b-b94e-1bc50306970c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.240686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.241315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.241598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.242564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.245744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ad768e16834b8e9efa22e6352911d0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:46.258188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.261084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.264426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ad768e16834b8e9efa22e6352911d0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:46.265295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ad768e16834b8e9efa22e6352911d0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:46.265926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-fcac8e9d-2c7a-4aa4-8b1e-b845664fca8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ad768e16834b8e9efa22e6352911d0'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:46.288382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1030/2066] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:46.289573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.301022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa533df4-e60c-4df9-a52a-57955fe26ed4 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.303307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1037/2067] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:45 2022] DELETE /identity/v3/users/21ad768e16834b8e9efa22e6352911d0 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:46.307074 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.308367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.309328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.360750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:46.362171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:46.405099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.405742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.410436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.410436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.410436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.410436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.497425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1038/2068] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:46.503355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.531450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72664535-1339-41a1-b8d8-592d8fe39292 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.536914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1031/2069] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:46.543258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.549677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.550534 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.550678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:46.551226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.551696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.552562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:46.553054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.556170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.570390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a99c1-69a8-4a1a-857c-e455badd4ae0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.577152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.578323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.578606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.580695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.581619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.582907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1039/2070] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:46.584241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.588554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.604067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1032/2071] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:46.607722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.613082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a3d2e-74d2-4f48-8a6c-c6c705d21e1c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.620380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.621445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.621915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.622879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.624669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.624834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3069-c739-47e7-bda2-ddddb71d3bec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.628420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.632681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.633402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.633614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.633880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.634539 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.636680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.652168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1033/2072] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:46.656433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.672318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8c61-d917-4874-a02a-065058aeadcd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.679224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:46.685031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.685031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.685031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] PATH_INFO: `/v3/projects/bfdbd60a2d9440f9863817160d10cfe6/users/4d5cb28984404535b2d56b2835c31f4b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.690173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:46.710432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbd60a2d9440f9863817160d10cfe6, user_id=4d5cb28984404535b2d56b2835c31f4b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:46.713479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee4b45-49c1-49f4-9708-dbadf4abf516 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:46.744707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1040/2073] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:46.752554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:46.816769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:46.835065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1034/2074] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:46 2022] PUT /identity/v3/projects/bfdbd60a2d9440f9863817160d10cfe6/users/4d5cb28984404535b2d56b2835c31f4b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:46.852551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:46.853120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:46.853431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:46.882709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae350cce-0ec3-49fe-874c-5151441f9f6e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:46.896898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] MFA Rules not processed for user `4d5cb28984404535b2d56b2835c31f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:46.898341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:47.008841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.009466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.009780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.010047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.010680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.013194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.064201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1035/2075] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:47.066025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.079031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe142-4938-4b31-8140-12abbde42de4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.086272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.087124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.087404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.087673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.088337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.090389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.214115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1041/2076] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:46 2022] POST /identity/v3/users => generated 285 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:47.218681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.221174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:47.238759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c507bd-62d0-4ad9-8cdc-9b0772ea73ff admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.249924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.251485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.251485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.251817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] PATH_INFO: `/v3/projects/02dc90bee9eb4eb99726521e27824e78` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.253443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dc90bee9eb4eb99726521e27824e78)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.257001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1036/2077] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:47 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:47.257001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.257218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.356944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186676ea-92d5-4eb2-a011-c895100212b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.365560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.366653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.367153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.371292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.371292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.372074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.385739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1037/2078] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:47.386715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.406271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8836-516e-4027-bb16-168f572f2a30 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.442588 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dc90bee9eb4eb99726521e27824e78', 'request_id': 'req-0d845d4e-8051-489d-90c9-d8007454cf0c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.456153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dc90bee9eb4eb99726521e27824e78', 'request_id': 'req-0d845d4e-8051-489d-90c9-d8007454cf0c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.496061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.496927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.497349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.497720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.499421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.502574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.585462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dc90bee9eb4eb99726521e27824e78', 'request_id': 'req-0d845d4e-8051-489d-90c9-d8007454cf0c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.604542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] The token cache is being invalidate because project 02dc90bee9eb4eb99726521e27824e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:47.604908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.605629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.608089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1042/2079] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:47 2022] DELETE /identity/v3/projects/02dc90bee9eb4eb99726521e27824e78 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:47.608701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.610081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:47.622999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1038/2080] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:47 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:47.627439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.635797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:47.638164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d845d4e-8051-489d-90c9-d8007454cf0c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.651508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8454bc-ba0d-48df-866f-c73ee77219ed admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.659252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.660037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.660317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.660591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.661322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.663208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.665832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.665832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.666133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.666657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] PATH_INFO: `/v3/users/2ce12e1b66db46a2a9ae9e8e7b1f0004` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.669199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce12e1b66db46a2a9ae9e8e7b1f0004)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.676469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.687216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1043/2081] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:47.688360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.690482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:47.719147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec529b0-98b4-42db-8f71-8f852081dd64 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.728807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.729913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.730423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.730933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.731935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.738120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.753908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1044/2082] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:47.754792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.776244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8b380-8651-4342-bd71-c46a4e773a1d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:47.784511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:47.785896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:47.786194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:47.786790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] PATH_INFO: `/v3/projects/ddff9e354d434f0a8444a5598cbc7595/users/9a6b34dbe81b48689ab9bc937aee7253/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:47.821912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddff9e354d434f0a8444a5598cbc7595, user_id=9a6b34dbe81b48689ab9bc937aee7253, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:47.827305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:47.941000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:47.941702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1045/2083] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:47 2022] PUT /identity/v3/projects/ddff9e354d434f0a8444a5598cbc7595/users/9a6b34dbe81b48689ab9bc937aee7253/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:47.943251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:47.959108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce12e1b66db46a2a9ae9e8e7b1f0004'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:47.991904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce12e1b66db46a2a9ae9e8e7b1f0004'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:48.068045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce12e1b66db46a2a9ae9e8e7b1f0004'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:48.069044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce12e1b66db46a2a9ae9e8e7b1f0004'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:48.093786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98e26775-f116-4596-bcee-65d215f28947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce12e1b66db46a2a9ae9e8e7b1f0004'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:48.105903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1039/2084] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:47 2022] DELETE /identity/v3/users/2ce12e1b66db46a2a9ae9e8e7b1f0004 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:48.105903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51188-65e7-470e-9396-29887d450331 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.105903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51188-65e7-470e-9396-29887d450331 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.105903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51188-65e7-470e-9396-29887d450331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.131632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6b0c-e0fa-4283-8578-885a69b3407d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.168958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:48.175485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5ea51188-65e7-470e-9396-29887d450331 None None] MFA Rules not processed for user `9a6b34dbe81b48689ab9bc937aee7253`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:48.177964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5ea51188-65e7-470e-9396-29887d450331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:48.260583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.261635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.262083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.262374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] PATH_INFO: `/v3/projects/092802417eb9418788f468cce0b8dc58/users/e25c04ec81214202a092c2e353f48ede/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.299322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1040/2085] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:48.300962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092802417eb9418788f468cce0b8dc58, user_id=e25c04ec81214202a092c2e353f48ede, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.311493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51188-65e7-470e-9396-29887d450331 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.311493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5ea51188-65e7-470e-9396-29887d450331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:48.312198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.334257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51188-65e7-470e-9396-29887d450331 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.343456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.344646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.345209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.345843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.347301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.351042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.405250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1046/2086] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:47 2022] PUT /identity/v3/projects/092802417eb9418788f468cce0b8dc58/users/e25c04ec81214202a092c2e353f48ede/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:48.412180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.417257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:48.489191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1041/2087] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:48 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:48.491470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.566496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720d339-8062-4c11-bbaf-689fe61c0846 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.607802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad21fc-d645-4e03-bb4d-66c04bac06d5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.614007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.614641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.614974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.615281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.616074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.618752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.711452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.714763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.714763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.714763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.715194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.719461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.741337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1047/2088] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:48.747488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.765735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b19271-0969-4bb2-b29e-dcd0f951133c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.772086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.773110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.775369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.775670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] PATH_INFO: `/v3/projects/092802417eb9418788f468cce0b8dc58/users/e25c04ec81214202a092c2e353f48ede/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.781326 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092802417eb9418788f468cce0b8dc58, user_id=e25c04ec81214202a092c2e353f48ede, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.787412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac096a1b-881f-480c-93fb-f1d6474b70d6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.796485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1042/2089] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:48 2022] POST /identity/v3/users => generated 290 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:48.802550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.806540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1048/2090] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:48 2022] PUT /identity/v3/projects/092802417eb9418788f468cce0b8dc58/users/e25c04ec81214202a092c2e353f48ede/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:48.818527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf75cb-e928-43fd-a6c1-6bdefe59526d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:48.821601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.821886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.822155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.880686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] MFA Rules not processed for user `e25c04ec81214202a092c2e353f48ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:48.887973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:48.941752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:48.943149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:48.943920 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:48.944394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:48.945398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:48.947929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:48.978984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:48.978984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1043/2091] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:48.978984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:48.981832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:49.022519 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09da3af-55f9-491f-9cc1-464037e89a73 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:49.032228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:49.033290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.033698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.034171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] PATH_INFO: `/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.036212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f9dc569b6d4d0e96b04ff2d5641d7d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:49.040794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:49.109523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1049/2092] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:49.111175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:49.133069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a70f-17df-4dfd-951f-6c3859e03091 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:49.154406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:49.162923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.162923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.162923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] PATH_INFO: `/v3/projects/7ee65a2c75924450baa0671fab75057f/users/a3ffa3b7032e40729850379ff23e0d3b/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.183981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee65a2c75924450baa0671fab75057f, user_id=a3ffa3b7032e40729850379ff23e0d3b, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:49.188314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:49.212160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f9dc569b6d4d0e96b04ff2d5641d7d', 'request_id': 'req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:49.229616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f9dc569b6d4d0e96b04ff2d5641d7d', 'request_id': 'req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:49.277230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1050/2093] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:49 2022] PUT /identity/v3/projects/7ee65a2c75924450baa0671fab75057f/users/a3ffa3b7032e40729850379ff23e0d3b/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:49.279213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:49.285147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:49.342635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f9dc569b6d4d0e96b04ff2d5641d7d', 'request_id': 'req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:49.371103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] The token cache is being invalidate because project c5f9dc569b6d4d0e96b04ff2d5641d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:49.372159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:49.373964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:49.384255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586171-4922-49d9-8dd4-96e6e8b84e68 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:49.385292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1044/2094] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:48 2022] DELETE /identity/v3/projects/c5f9dc569b6d4d0e96b04ff2d5641d7d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:49.386986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:49.388043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:49.389897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.390452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.390863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.394616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:49.398811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:49.510431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:49.512532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c44bf1-32bb-458e-b7fa-b60a9aeda3b0 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:49.533311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33d11-d0c8-4fc4-9ecd-e6cc46bed2ae admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:49.548681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1051/2095] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:49.550885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685496f-565b-48fc-8398-6cf3c0d57b46 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.554071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685496f-565b-48fc-8398-6cf3c0d57b46 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.554654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685496f-565b-48fc-8398-6cf3c0d57b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.594190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:49.621809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9685496f-565b-48fc-8398-6cf3c0d57b46 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:49.631947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9685496f-565b-48fc-8398-6cf3c0d57b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:49.723963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:49.724615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.724901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.725163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.725953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:49.727623 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:49.777843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1045/2096] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:49.783939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:49.801331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa540-47c7-456f-9e18-b8d3501a7dee admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:49.807003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:49.809796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.809796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.809796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] PATH_INFO: `/v3/projects/7ee65a2c75924450baa0671fab75057f/users/a3ffa3b7032e40729850379ff23e0d3b/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.812709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee65a2c75924450baa0671fab75057f, user_id=a3ffa3b7032e40729850379ff23e0d3b, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:49.818469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81486b8-134c-44d4-94d4-600e4d0a9026 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:49.838329 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1046/2097] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:49 2022] PUT /identity/v3/projects/7ee65a2c75924450baa0671fab75057f/users/a3ffa3b7032e40729850379ff23e0d3b/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:49.851976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.852873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.853625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.868175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1052/2098] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:49.905617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:49.906003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:49.906470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:49.968917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:49.968917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:50.009460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] MFA Rules not processed for user `a3ffa3b7032e40729850379ff23e0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:50.011699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:50.141799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1053/2099] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:50.142867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.162847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd20504-676b-4307-b314-a346d84f2713 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.179911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.180556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.180842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.181177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.181760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:50.182058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.183747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.204669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1047/2100] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:50.223419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1054/2101] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:50.229131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.248876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.251077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:50.253080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef64d6f-a3a2-4a6c-9d0e-610d73739288 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.261278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.262286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.262670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.263046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.264792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.266937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.334421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:50.340051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6d5f1-5cbb-48a1-9994-331cfbdc866a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.346712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.347887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.348502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.349010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.368285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.372499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.380072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1048/2102] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:50 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:50.384838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.393552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1055/2103] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:50.479120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674918a4-1332-477b-b74d-939eb49af9f7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.485854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.486479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.486754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.487025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.487785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.489671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.520799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.536499 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ae711-a363-4ced-bdd4-6ff44beddc81 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.604614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1049/2104] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:50 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:50.613125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.635461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44f4de-db73-4ce1-ae52-8a716fbd9841 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.651596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.652658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.652973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.653660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.655546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.658105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.669224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.671309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.672425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.672970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.677154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1050/2105] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:50.682557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.690193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:50.699413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e13a68-f47d-4e60-a013-d5a91b8dbb43 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.710609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.711735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.712126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.712428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.715557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.718689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.745717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1051/2106] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:50.747039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:50.763981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d9fe-6a0c-47aa-85ba-d7d7f232e37e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:50.773157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:50.776012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.776750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.777643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] PATH_INFO: `/v3/projects/c52152ff982b47e2af063154a82bd923/users/809deb32569f445d91507760c9a3259b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.826895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52152ff982b47e2af063154a82bd923, user_id=809deb32569f445d91507760c9a3259b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.830333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.842831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:50.844806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d761-ede0-4659-98b8-202f9d301bb2 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:50.858541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1056/2107] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:21:50.924477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1052/2108] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:50 2022] PUT /identity/v3/projects/c52152ff982b47e2af063154a82bd923/users/809deb32569f445d91507760c9a3259b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:50.925847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:50.926733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:50.926733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:50.963542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:50.974542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] MFA Rules not processed for user `809deb32569f445d91507760c9a3259b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:50.976115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:51.093094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.154422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1057/2109] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:51.155958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.224513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e1ba-272c-4d13-b7f7-3e3de5ea9563 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.231520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e25c04ec81214202a092c2e353f48ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092802417eb9418788f468cce0b8dc58', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.232229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.233139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.233459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.234171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:51.234475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.254026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:51.273310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1053/2110] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:51.279141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.301908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782caae-35d9-415b-9326-8e47dc7691e8 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.315709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e25c04ec81214202a092c2e353f48ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092802417eb9418788f468cce0b8dc58', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.317076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.318025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.318025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.318898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.323517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:51.367262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:51.385450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d672b7-7bbb-4516-9b7c-33c910d32230 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.396196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.398155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.402035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.402035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.402035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.407274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:51.581468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1058/2111] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:51 2022] POST /identity/v3/projects => generated 385 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:51.588161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.590855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1054/2112] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:51 2022] POST /identity/v3/projects => generated 352 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:51.612242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.629719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:51.798382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43b3b-ad18-49c0-b7a4-f280210a520e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.833383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea66b5-9c0c-44ab-ba60-a5c4a6f4bffc tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.843921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e25c04ec81214202a092c2e353f48ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092802417eb9418788f468cce0b8dc58', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.844726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.845190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.845612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.850905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:51.851635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.854118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:51.876349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1055/2113] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:51.901610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.902222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.902681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.902957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.903594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.905800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:51.944418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:51.960835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12555-8f75-4c75-ad19-b557e63580ee tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:51.965401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e25c04ec81214202a092c2e353f48ede', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '092802417eb9418788f468cce0b8dc58', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:51.966132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:51.966323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:51.966689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] PATH_INFO: `/v3/projects/1e0e76cfa96f49a69b376e105e162459` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:51.968514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e0e76cfa96f49a69b376e105e162459)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:51.970494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:52.164426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1059/2114] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:51 2022] POST /identity/v3/users => generated 299 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:21:52.169092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:52.181847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ad575-54ef-44b7-b64a-d729daa17cf1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:52.195962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0e76cfa96f49a69b376e105e162459', 'request_id': 'req-e2c5538a-a550-4c2a-a679-c9bed9a07053'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:52.258786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0e76cfa96f49a69b376e105e162459', 'request_id': 'req-e2c5538a-a550-4c2a-a679-c9bed9a07053'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:52.301259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:52.301891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:52.302332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:52.302758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:52.303576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:52.305625 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:52.325151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1060/2115] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:52.329271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:52.343925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0f25e-68b1-4878-bf18-19541d07dfc4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:52.349843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:52.350798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:52.351284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:52.351809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] PATH_INFO: `/v3/projects/bfe76e6ef99748b88892f977df3d1434/users/abbe9d8fc09f4d8cbf152def4a83d40b/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:52.373945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe76e6ef99748b88892f977df3d1434, user_id=abbe9d8fc09f4d8cbf152def4a83d40b, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:52.377113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:52.397651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0e76cfa96f49a69b376e105e162459', 'request_id': 'req-e2c5538a-a550-4c2a-a679-c9bed9a07053'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:52.417450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] The token cache is being invalidate because project 1e0e76cfa96f49a69b376e105e162459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:52.417783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:52.419599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:52.423803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1056/2116] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:51 2022] DELETE /identity/v3/projects/1e0e76cfa96f49a69b376e105e162459 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:21:52.480577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1061/2117] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:52 2022] PUT /identity/v3/projects/bfe76e6ef99748b88892f977df3d1434/users/abbe9d8fc09f4d8cbf152def4a83d40b/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:52.489260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:52.493830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:52.537280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5538a-a550-4c2a-a679-c9bed9a07053 tempest-VolumeQuotaClassesTest-1662427682 tempest-VolumeQuotaClassesTest-1662427682-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:52.632704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:52.633897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:52.634379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:52.634803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:52.635950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:52.637938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117e4dc-956c-444f-932d-8a5510b1e557 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:52.660184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1057/2118] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:21:52.661994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:52.691359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac748f7-5a5c-47b7-a264-f690fcffae2b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:52.726901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:52.726901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:52.726901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:52.726901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] PATH_INFO: `/v3/projects/bfe76e6ef99748b88892f977df3d1434/users/abbe9d8fc09f4d8cbf152def4a83d40b/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:52.727654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe76e6ef99748b88892f977df3d1434, user_id=abbe9d8fc09f4d8cbf152def4a83d40b, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:52.734734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:52.751370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1062/2119] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:52 2022] PUT /identity/v3/projects/bfe76e6ef99748b88892f977df3d1434/users/abbe9d8fc09f4d8cbf152def4a83d40b/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:52.771008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:52.771608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:52.772261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:52.826984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] MFA Rules not processed for user `abbe9d8fc09f4d8cbf152def4a83d40b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:52.826984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:52.957027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1058/2120] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:52.977824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:52.979887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:53.088710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:53.122138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178439-6184-458f-996a-ac6e32904684 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:53.129662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:53.130863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:53.131456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:53.132107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:53.135694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:53.259467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:53.261089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916eaac-0b85-4ae0-93ec-189fdc5a49da service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:53.272484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:53.277772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1063/2121] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:53.551078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:53.699748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:53.707277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:53.861289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ac6e4-d8df-4a9e-be92-0fddcb41cc64 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:53.867636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:53.868471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:53.868823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:53.869169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] PATH_INFO: `/v3/users/4d5cb28984404535b2d56b2835c31f4b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:53.870800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5cb28984404535b2d56b2835c31f4b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:53.876345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:54.355109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5cb28984404535b2d56b2835c31f4b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:54.366895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5cb28984404535b2d56b2835c31f4b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:54.544417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:54.555893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5cb28984404535b2d56b2835c31f4b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:54.555893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5cb28984404535b2d56b2835c31f4b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:54.582890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5cb28984404535b2d56b2835c31f4b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:54.591595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1059/2122] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:53 2022] DELETE /identity/v3/users/4d5cb28984404535b2d56b2835c31f4b => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:54.599263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:54.601853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:54.601853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:54.636801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:54.638419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:54.781451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1064/2123] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:54.791895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:54.793259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:54.930888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880f91e-39e5-4814-b05c-07d1eb4d2390 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:54.937717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:54.943663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:54.943663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:54.943663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:54.966137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:54.969822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea821c-4fed-46f7-b79a-bbdcb1d6ead8 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:54.999859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1060/2124] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:55.026568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:55.893737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:55.895439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:55.928285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e2245-3436-4396-92ef-6a20606978c2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:55.944864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:55.944864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:55.945396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:55.945991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] PATH_INFO: `/v3/projects/bfdbd60a2d9440f9863817160d10cfe6` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:55.949107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdbd60a2d9440f9863817160d10cfe6)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:55.954328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:56.177765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdbd60a2d9440f9863817160d10cfe6', 'request_id': 'req-7957bba6-0f83-494d-bb7b-d7cf9028a849'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:56.193471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdbd60a2d9440f9863817160d10cfe6', 'request_id': 'req-7957bba6-0f83-494d-bb7b-d7cf9028a849'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:56.282682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:56.283643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:56.284476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:56.302277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdbd60a2d9440f9863817160d10cfe6', 'request_id': 'req-7957bba6-0f83-494d-bb7b-d7cf9028a849'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:56.327555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] The token cache is being invalidate because project bfdbd60a2d9440f9863817160d10cfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:56.328490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:56.329856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:56.336063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1065/2125] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:55 2022] DELETE /identity/v3/projects/bfdbd60a2d9440f9863817160d10cfe6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:56.337982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:56.341160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:56.356364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] MFA Rules not processed for user `53d8816f0b3a4cb1a9da6dc11428b514`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:56.357834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:56.521172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1061/2126] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:56.533893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bba6-0f83-494d-bb7b-d7cf9028a849 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:56.542660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:56.544516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:56.547449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:56.548463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:56.549018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:56.549475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] PATH_INFO: `/v3/users/e25c04ec81214202a092c2e353f48ede` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:56.550876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25c04ec81214202a092c2e353f48ede)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:56.553031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:56.688240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b482-e058-48c8-8938-b9dd86a230fa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:56.698993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:56.700065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:56.700523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:56.701586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:56.722323 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:56.728320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:56.754127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1062/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:21:56.855829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:56.926956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25c04ec81214202a092c2e353f48ede'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:57.112730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25c04ec81214202a092c2e353f48ede'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:57.134492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25c04ec81214202a092c2e353f48ede'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:57.135298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25c04ec81214202a092c2e353f48ede'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:57.136035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-07290f0a-acd8-45f3-a476-9740e9424a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25c04ec81214202a092c2e353f48ede'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:57.153562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1066/2128] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:56 2022] DELETE /identity/v3/users/e25c04ec81214202a092c2e353f48ede => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:57.352672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:21:57.960761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:57.987706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408414e-47bd-44e3-903e-224335d0b69b service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:58.087580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:58.089063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:58.089341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:58.090205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] PATH_INFO: `/v3/projects/092802417eb9418788f468cce0b8dc58` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:58.092935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092802417eb9418788f468cce0b8dc58)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:58.095062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:58.292754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092802417eb9418788f468cce0b8dc58', 'request_id': 'req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:58.308682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092802417eb9418788f468cce0b8dc58', 'request_id': 'req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:58.562310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092802417eb9418788f468cce0b8dc58', 'request_id': 'req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:58.581246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] The token cache is being invalidate because project 092802417eb9418788f468cce0b8dc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:21:58.581728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:58.582733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5d21bc02-3b72-4a6a-a7f3-832a2b51da18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:58.585552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1063/2129] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:21:57 2022] DELETE /identity/v3/projects/092802417eb9418788f468cce0b8dc58 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:58.590794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:58.591649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:58.591649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:58.612656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:58.613899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:58.680520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1067/2130] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:21:58.690444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:58.690757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:58.690997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:58.711695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:21:58.712866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:58.721221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1064/2131] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:21:58.725880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:58.736392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bb69f-fa43-47af-b0f0-8c6258ffbd78 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:58.741145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:58.741746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:58.742026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:58.742295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:58.742940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:21:58.743239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:58.745143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:58.758366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1068/2132] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:21:58.763052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:58.772741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbf838-8e9f-46f6-bbb7-bae894e175f0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:58.777775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:58.778432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:58.778708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:58.778973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:58.779622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:58.781732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.059278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1065/2133] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:21:58 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:59.060864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:59.073268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497516-07c7-47d1-95f4-318a8e7d84b3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:59.156013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:59.157091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.157360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.157630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:59.158281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:59.160516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.273838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:59.276535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:21:59.291146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea6f5-4bd9-443a-a8d4-1814f5a20a16 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:59.297758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:59.298557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.298926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.299282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] PATH_INFO: `/v3/users/9a6b34dbe81b48689ab9bc937aee7253` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:59.300638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6b34dbe81b48689ab9bc937aee7253)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:59.302686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.412033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1069/2134] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:21:59 2022] POST /identity/v3/users => generated 288 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:21:59.417826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:59.433213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79622ec-4358-409e-9968-f784b54dc94c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:59.439951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:59.441294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.441294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.441604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:59.442236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:59.444034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.458013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1070/2135] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:59.465696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:59.478809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9722-9db3-475a-b12f-450299941680 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:59.486369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:59.487000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.487523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.487813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:59.488695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:59.490413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.509365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1071/2136] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:21:59.519440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:21:59.537568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ff46f-f106-4637-a1be-5de296ad799b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:21:59.545848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:21:59.547011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.547439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.547960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] PATH_INFO: `/v3/projects/65f90e9f47a047a1b74d49ff606197d0/users/5bca3c02c4524c5e95ab14fe2faaa0bb/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:21:59.574174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f90e9f47a047a1b74d49ff606197d0, user_id=5bca3c02c4524c5e95ab14fe2faaa0bb, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:21:59.578967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1167e-1f11-4904-a451-fdfda05130c6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:21:59.860229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6b34dbe81b48689ab9bc937aee7253'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:59.870123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6b34dbe81b48689ab9bc937aee7253'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:21:59.974816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1072/2137] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:21:59 2022] PUT /identity/v3/projects/65f90e9f47a047a1b74d49ff606197d0/users/5bca3c02c4524c5e95ab14fe2faaa0bb/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:21:59.981697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:21:59.982008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:21:59.982737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:00.041131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] MFA Rules not processed for user `5bca3c02c4524c5e95ab14fe2faaa0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:00.044393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:00.114485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6b34dbe81b48689ab9bc937aee7253'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:00.127033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6b34dbe81b48689ab9bc937aee7253'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:00.172488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1073/2138] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:00.190187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:00.193838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:00.220494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba3c5e9c-9092-43bb-8422-505121575426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6b34dbe81b48689ab9bc937aee7253'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:00.230141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1066/2139] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:21:59 2022] DELETE /identity/v3/users/9a6b34dbe81b48689ab9bc937aee7253 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:00.236116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:00.240857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:00.241348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:00.306620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:00.308130 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:00.331063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2473e-6015-4357-8dd3-f704d2cfbd6f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:00.409411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:00.410047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:00.410323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:00.410592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:00.412559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:00.414775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1067/2140] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:00.425273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:00.426663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:00.487476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:00.489354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503bc09-6526-4e48-a2a9-92958781217d service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:00.502126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1074/2141] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:00.507283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2700a0-9fd6-489c-b9e9-4a7a702540e9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:00.511884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:00.512690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:00.513182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:00.513622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:00.524464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:00.526097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:00.542221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1068/2142] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:01.230521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:01.231243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:01.231243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:01.255229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] MFA Rules not processed for user `53d8816f0b3a4cb1a9da6dc11428b514`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:01.256591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:01.323910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1075/2143] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:01.524762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:01.533942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:01.536243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:01.552259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1efcd2-9c5e-4e1c-81ec-5052f4a7addf service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:01.563266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:01.568384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:01.568384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:01.568384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] PATH_INFO: `/v3/projects/ddff9e354d434f0a8444a5598cbc7595` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:01.568384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddff9e354d434f0a8444a5598cbc7595)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:01.569190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:01.762810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddff9e354d434f0a8444a5598cbc7595', 'request_id': 'req-ea5bb7af-df50-4c17-b060-e59f6890f4dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:01.773214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddff9e354d434f0a8444a5598cbc7595', 'request_id': 'req-ea5bb7af-df50-4c17-b060-e59f6890f4dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:01.875339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddff9e354d434f0a8444a5598cbc7595', 'request_id': 'req-ea5bb7af-df50-4c17-b060-e59f6890f4dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:01.893555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] The token cache is being invalidate because project ddff9e354d434f0a8444a5598cbc7595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:01.893555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:01.893555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:01.895846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1069/2144] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:01 2022] DELETE /identity/v3/projects/ddff9e354d434f0a8444a5598cbc7595 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:01.899857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:01.918550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6804e-0e28-45f6-bf10-0cdeeb745f3c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:02.013410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:02.013410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:02.013410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:02.013410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] PATH_INFO: `/v3/users/a3ffa3b7032e40729850379ff23e0d3b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:02.020533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ffa3b7032e40729850379ff23e0d3b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:02.020533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:02.104941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:02.352386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ffa3b7032e40729850379ff23e0d3b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:02.437971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ffa3b7032e40729850379ff23e0d3b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:02.455531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ffa3b7032e40729850379ff23e0d3b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:02.456802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ffa3b7032e40729850379ff23e0d3b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:02.457502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dd7876c9-1f5c-4292-9b48-6cada1ff1f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ffa3b7032e40729850379ff23e0d3b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:02.478633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1076/2145] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:01 2022] DELETE /identity/v3/users/a3ffa3b7032e40729850379ff23e0d3b => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:03.067269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:03.070219 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:03.104192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb7af-df50-4c17-b060-e59f6890f4dc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:03.215428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:03.217164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:03.217640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:03.218083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] PATH_INFO: `/v3/projects/7ee65a2c75924450baa0671fab75057f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:03.220050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee65a2c75924450baa0671fab75057f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:03.226360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:03.424650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee65a2c75924450baa0671fab75057f', 'request_id': 'req-523b61ab-1034-4388-baa8-3badd54de4bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:03.431811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee65a2c75924450baa0671fab75057f', 'request_id': 'req-523b61ab-1034-4388-baa8-3badd54de4bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:03.613884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee65a2c75924450baa0671fab75057f', 'request_id': 'req-523b61ab-1034-4388-baa8-3badd54de4bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:03.635152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] The token cache is being invalidate because project 7ee65a2c75924450baa0671fab75057f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:03.635518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:03.636322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-523b61ab-1034-4388-baa8-3badd54de4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:03.638124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1070/2146] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:03 2022] DELETE /identity/v3/projects/7ee65a2c75924450baa0671fab75057f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:03.644013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:03.644923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:03.645083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:03.668270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:03.670257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:03.732745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1077/2147] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:03.740809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:03.741085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:03.741353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:03.761834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:03.763122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:03.771666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1071/2148] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:03.776136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:03.787232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7fb48-6929-46ec-9d9c-fc71c1104a7b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:03.791910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:03.792513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:03.792789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:03.793081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:03.793809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:22:03.794271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:03.796503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:03.812662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1078/2149] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:22:03.817315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:03.827226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ba48-420b-44ae-a9b8-7fc1807bac30 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:03.832242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:03.832854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:03.833125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:03.833391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:03.836446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:03.836446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:03.989353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1072/2150] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:03 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:03.992657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:04.015881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c938abf-6c67-465a-bc09-b8dd2fd555d9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:04.110455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:04.111068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.111347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.111616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.112972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:04.114923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:04.285668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1079/2151] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:03 2022] POST /identity/v3/users => generated 291 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:04.296240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:04.307510 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb8bd7-7889-4ba1-9565-e87e50810473 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:04.320194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:04.320943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.321270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.323607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.323607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:04.325005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:04.355675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1073/2152] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:04.361438 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:04.380019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b93626-2f9e-4fcd-a751-efd8dca3c86a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:04.387648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:04.389157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.389629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.390113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.390965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:04.393392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d6cc3-813d-42bb-a1fb-11a7b24c32be admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:04.411157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1080/2153] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:04.416277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:04.431991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636abf0-123e-404e-af3e-0425dbc7ca02 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:04.444843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:04.446087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.446532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.446966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] PATH_INFO: `/v3/projects/3c21978af72347b2a962cea007ded322/users/cf30378a391b465d92a0f1df7d81c081/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.477319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c21978af72347b2a962cea007ded322, user_id=cf30378a391b465d92a0f1df7d81c081, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:04.480838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:04.580950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1074/2154] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:04 2022] PUT /identity/v3/projects/3c21978af72347b2a962cea007ded322/users/cf30378a391b465d92a0f1df7d81c081/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:04.593445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252604d-8416-458e-9590-5993b9919afe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.593816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252604d-8416-458e-9590-5993b9919afe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.594114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252604d-8416-458e-9590-5993b9919afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.630011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e252604d-8416-458e-9590-5993b9919afe None None] MFA Rules not processed for user `cf30378a391b465d92a0f1df7d81c081`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:04.631485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e252604d-8416-458e-9590-5993b9919afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:04.725222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1081/2155] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:04.746203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:04.782906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:04.858664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294055bc-d72d-48a7-9443-9d6e653c08f9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:04.863726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:04.864811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:04.864996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:04.865110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:04.865745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:04.867658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.039721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1075/2156] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:04 2022] POST /identity/v3/projects => generated 381 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:22:05.044022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252604d-8416-458e-9590-5993b9919afe None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.055712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252604d-8416-458e-9590-5993b9919afe None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.117830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.118421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.118693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.118958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.119871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.121866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.314757 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1082/2157] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:05 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:22:05.319258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.332817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d18a-a34f-44c3-91cf-e91d0b684260 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.337786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.338410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.338794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.338954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.339601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.341305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.356781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1076/2158] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:05.371486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.383971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e3ede-fa2a-4e55-aaed-0e43ff777d2e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.393996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.394921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.395375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.395842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] PATH_INFO: `/v3/projects/eeaa5f2021be4efcb40e240105e54a86/users/3b2e9093480a4ddbb786fd288a994e78/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.422701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaa5f2021be4efcb40e240105e54a86, user_id=3b2e9093480a4ddbb786fd288a994e78, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.422701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.494695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.498314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:05.542472 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1083/2159] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:05 2022] PUT /identity/v3/projects/eeaa5f2021be4efcb40e240105e54a86/users/3b2e9093480a4ddbb786fd288a994e78/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:05.548055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.577797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d9c2-c70b-4e34-b26f-35c15f75fb24 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.641464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabf7e1-b905-4d39-aca8-576c2afe6632 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.646742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.647573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.647886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.648200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.648861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.650490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.664966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1084/2160] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:05.667349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:05.670532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.672427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.673057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.673336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.673719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.675664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:05.682740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33872e20-6080-40a6-8068-40996491f907 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:05.690056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:05.691081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.691519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.692014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] PATH_INFO: `/v3/projects/eeaa5f2021be4efcb40e240105e54a86/users/3b2e9093480a4ddbb786fd288a994e78/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.695279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaa5f2021be4efcb40e240105e54a86, user_id=3b2e9093480a4ddbb786fd288a994e78, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.700081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aaed6-9d46-407b-b24c-7d5fcdafb1fc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.717820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1085/2161] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:05 2022] PUT /identity/v3/projects/eeaa5f2021be4efcb40e240105e54a86/users/3b2e9093480a4ddbb786fd288a994e78/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:05.735048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:05.735718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:05.735718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:05.755540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:05.757085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:05.767976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1077/2162] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:05.771312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] MFA Rules not processed for user `3b2e9093480a4ddbb786fd288a994e78`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:05.773102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:05.933599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1086/2163] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:05.948325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:05.949944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:05.966153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64bce8-8bcc-4f45-b26b-99e1d6ce9761 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:06.047241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:06.048214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:06.048491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:06.048757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:06.066521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:06.069324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:06.089126 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1078/2164] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:06.683033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:06.700781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050184cb-ec2e-4cf0-8009-27216c393a80 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:06.710930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:06.711876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:06.712192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:06.712398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:06.801420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:06.803127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b8d6-f23e-4ec0-ace2-c86813b00909 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:06.819058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1087/2165] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:07.120605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:07.122165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:07.252322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c774-e1ef-4f6b-a0d3-e44bf375900b service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:07.257572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:07.258269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:07.258594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:07.258869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] PATH_INFO: `/v3/users/5bca3c02c4524c5e95ab14fe2faaa0bb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:07.260437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bca3c02c4524c5e95ab14fe2faaa0bb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:07.262634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:07.633171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bca3c02c4524c5e95ab14fe2faaa0bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:07.647943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bca3c02c4524c5e95ab14fe2faaa0bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:07.753031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:07.815484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bca3c02c4524c5e95ab14fe2faaa0bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:07.816449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bca3c02c4524c5e95ab14fe2faaa0bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:07.836293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bca3c02c4524c5e95ab14fe2faaa0bb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:07.851943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1079/2166] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:07 2022] DELETE /identity/v3/users/5bca3c02c4524c5e95ab14fe2faaa0bb => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:07.864756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:07.865672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:07.866120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:07.910929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:07.912589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:08.043327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:08.060608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1088/2167] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:08.078416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:08.079894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:08.301959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d16e6-a67f-45e8-ae27-8b541b5f4915 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:08.312912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:08.313547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:08.314113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:08.315883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:08.329711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:08.332740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb2201-79f5-44d1-9a1d-bbcfb5fe3b04 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:08.345373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1080/2168] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:08.541062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:09.198196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:09.199673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:09.214175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07caaf1-09f7-4a1c-9f24-d725f626d255 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:09.221056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:09.221056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:09.221056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:09.221056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] PATH_INFO: `/v3/projects/65f90e9f47a047a1b74d49ff606197d0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:09.230548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f90e9f47a047a1b74d49ff606197d0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:09.230548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:09.372093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f90e9f47a047a1b74d49ff606197d0', 'request_id': 'req-8ffeae1b-551d-4211-b95a-d8059af81ef9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:09.390657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f90e9f47a047a1b74d49ff606197d0', 'request_id': 'req-8ffeae1b-551d-4211-b95a-d8059af81ef9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:09.489106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f90e9f47a047a1b74d49ff606197d0', 'request_id': 'req-8ffeae1b-551d-4211-b95a-d8059af81ef9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:09.502574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] The token cache is being invalidate because project 65f90e9f47a047a1b74d49ff606197d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:09.502861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:09.503935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ffeae1b-551d-4211-b95a-d8059af81ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:09.505576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1089/2169] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:09 2022] DELETE /identity/v3/projects/65f90e9f47a047a1b74d49ff606197d0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:09.512408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:09.512997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:09.512997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:09.539617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:09.539617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:09.628585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1081/2170] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:09.643090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:09.643384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:09.644024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:09.670214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:09.670214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:09.678828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1090/2171] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:09.685357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:09.704312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e025ff-edc1-47d8-9862-705203fb60bf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:09.710252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:09.710892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:09.711164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:09.711914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:09.712650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:22:09.712950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:09.715341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:09.734595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1082/2172] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:22:09.743182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:09.765570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2838-4a3d-4f46-b806-be05e1dcb2bc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:09.774288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:09.775967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:09.776415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:09.776851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:09.777899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:09.782270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:09.901780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1091/2173] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:09 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:09.905497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:09.931091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e2cc1-7f30-4cee-96e1-f74ad27d762d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:10.017003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:10.018049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.018545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.019018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.020144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:10.023799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:10.203464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1083/2174] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:09 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:10.208763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:10.223048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8947-1ac9-4b19-97f6-2feb96af0609 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:10.228780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:10.229568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.229919 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.230287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.230929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:10.233036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:10.261212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:10.267945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1092/2175] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:10.277947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881ffd7-f1b7-470d-9c34-d0db9f2a7785 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:10.287581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:10.287581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.287581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.287581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.293480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:10.296734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf51d-bc88-469d-86ce-cc5eed64b449 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:10.323634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1084/2176] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:10.339272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:10.364840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca516-0241-41ca-a690-155cb2ead0df admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:10.369195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:10.370219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.370558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.370877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] PATH_INFO: `/v3/projects/4767f748b55f40958e6976d42c58b4fd/users/f37cab4f820446e0bcdb720c5867f6ff/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.387372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4767f748b55f40958e6976d42c58b4fd, user_id=f37cab4f820446e0bcdb720c5867f6ff, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:10.390491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:10.565483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1093/2177] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:10 2022] PUT /identity/v3/projects/4767f748b55f40958e6976d42c58b4fd/users/f37cab4f820446e0bcdb720c5867f6ff/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:10.572096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.572634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.572997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.594452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:10.594968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:10.696284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1085/2178] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:10.697560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:10.708500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:10.752979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:10.780346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eb825-60ca-4d7b-80fa-1e01169bce60 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:10.784043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:10.784666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:10.784946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:10.785224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:10.795198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:10.796953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8432b42-fc47-44c5-8256-2b0d57cf608a service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:10.811258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1094/2179] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:11.283575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:11.734731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:11.738036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:11.750305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a53d9c-45a8-46d0-955b-76fc6742ae95 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:11.754957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:11.755589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:11.755897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:11.756168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] PATH_INFO: `/v3/users/cf30378a391b465d92a0f1df7d81c081` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:11.757301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf30378a391b465d92a0f1df7d81c081)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:11.759250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:12.066262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf30378a391b465d92a0f1df7d81c081'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:12.075194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf30378a391b465d92a0f1df7d81c081'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:12.214859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf30378a391b465d92a0f1df7d81c081'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:12.215470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf30378a391b465d92a0f1df7d81c081'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:12.237415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf30378a391b465d92a0f1df7d81c081'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:12.243675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1086/2180] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:11 2022] DELETE /identity/v3/users/cf30378a391b465d92a0f1df7d81c081 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:12.248777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:12.249405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:12.249687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:12.276407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:12.277647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:12.420171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1095/2181] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:12.433306 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:12.435676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:12.523512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429da449-b4ff-44e6-a0b1-bfcdcb059aab admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:12.530648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:12.531518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:12.531984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:12.533389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:12.553049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:12.554994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:12.579968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1087/2182] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:13.216812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:13.449900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:13.453043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:13.471522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf09ba8-5ebb-4b81-9576-f1335d81dc95 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:13.476479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:13.477095 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:13.477402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:13.477652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] PATH_INFO: `/v3/users/809deb32569f445d91507760c9a3259b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:13.479022 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=809deb32569f445d91507760c9a3259b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:13.481028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:13.552615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:13.557768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:13.600135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f171af-c437-46c5-ad20-783d8c4fe854 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:13.615169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:13.615992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:13.616269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:13.616574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] PATH_INFO: `/v3/projects/3c21978af72347b2a962cea007ded322` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:13.625814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c21978af72347b2a962cea007ded322)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:13.627796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:13.730724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:13.736901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809deb32569f445d91507760c9a3259b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.910624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c21978af72347b2a962cea007ded322', 'request_id': 'req-47f64ee1-454a-40d7-a0d5-c416af8d2fee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.923664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809deb32569f445d91507760c9a3259b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.938697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c21978af72347b2a962cea007ded322', 'request_id': 'req-47f64ee1-454a-40d7-a0d5-c416af8d2fee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.945615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809deb32569f445d91507760c9a3259b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.946541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809deb32569f445d91507760c9a3259b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.947119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-79aedc61-abf9-4221-9e57-ec2870b83c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809deb32569f445d91507760c9a3259b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:13.965254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1096/2183] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:13 2022] DELETE /identity/v3/users/809deb32569f445d91507760c9a3259b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:13.970930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:13.971571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:13.971884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:13.997991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:13.999374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:14.033163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c21978af72347b2a962cea007ded322', 'request_id': 'req-47f64ee1-454a-40d7-a0d5-c416af8d2fee'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.050275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] The token cache is being invalidate because project 3c21978af72347b2a962cea007ded322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:14.050878 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.051666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.053336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1088/2184] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:13 2022] DELETE /identity/v3/projects/3c21978af72347b2a962cea007ded322 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:14.057304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:14.058776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:14.099920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1097/2185] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:14.110562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:14.112583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:14.162153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64ee1-454a-40d7-a0d5-c416af8d2fee admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:14.169833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:14.180072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:14.180072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:14.180072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] PATH_INFO: `/v3/users/3b2e9093480a4ddbb786fd288a994e78` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:14.180072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2e9093480a4ddbb786fd288a994e78)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:14.180072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:14.195889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be94604-8520-4ba4-9eda-94f4c259bed0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:14.200294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:14.200905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:14.201183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:14.201530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:14.212647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:14.214264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:14.225906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1098/2186] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:14.519123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2e9093480a4ddbb786fd288a994e78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.528591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2e9093480a4ddbb786fd288a994e78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.712190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2e9093480a4ddbb786fd288a994e78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.713641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2e9093480a4ddbb786fd288a994e78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.731713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2e9093480a4ddbb786fd288a994e78'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:14.739403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1089/2187] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:14 2022] DELETE /identity/v3/users/3b2e9093480a4ddbb786fd288a994e78 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:14.807313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:14.810609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:14.854888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afc265-0b0c-4e12-9cc7-e540cf6767cf service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:14.965635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:14.966483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:14.966766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:14.967040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] PATH_INFO: `/v3/projects/c52152ff982b47e2af063154a82bd923` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:14.969932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52152ff982b47e2af063154a82bd923)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:14.974294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:15.197102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52152ff982b47e2af063154a82bd923', 'request_id': 'req-0ba4de63-aecd-401b-b5fa-809709c95899'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.210580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52152ff982b47e2af063154a82bd923', 'request_id': 'req-0ba4de63-aecd-401b-b5fa-809709c95899'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.350773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52152ff982b47e2af063154a82bd923', 'request_id': 'req-0ba4de63-aecd-401b-b5fa-809709c95899'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.401020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] The token cache is being invalidate because project c52152ff982b47e2af063154a82bd923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:15.401512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.402214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.403790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1099/2188] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:14 2022] DELETE /identity/v3/projects/c52152ff982b47e2af063154a82bd923 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:15.409815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:15.411261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:15.425498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d3bff-bcea-4a2a-bc16-b8a9e6da9bbb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:15.504356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:15.506348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:15.513886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:15.515507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:15.516013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:15.516569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] PATH_INFO: `/v3/users/abbe9d8fc09f4d8cbf152def4a83d40b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:15.518107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbe9d8fc09f4d8cbf152def4a83d40b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:15.520708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:15.541998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4de63-aecd-401b-b5fa-809709c95899 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:15.541998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:15.541998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:15.541998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:15.542584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] PATH_INFO: `/v3/projects/eeaa5f2021be4efcb40e240105e54a86` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:15.542584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeaa5f2021be4efcb40e240105e54a86)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:15.543676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:15.760989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbe9d8fc09f4d8cbf152def4a83d40b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.762725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeaa5f2021be4efcb40e240105e54a86', 'request_id': 'req-704a15a0-461d-4b18-a37c-5d9aecee476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.770824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeaa5f2021be4efcb40e240105e54a86', 'request_id': 'req-704a15a0-461d-4b18-a37c-5d9aecee476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.770965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbe9d8fc09f4d8cbf152def4a83d40b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.845360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:15.907274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbe9d8fc09f4d8cbf152def4a83d40b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.908024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbe9d8fc09f4d8cbf152def4a83d40b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.931106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5124c05b-d805-4872-a42d-55a02404b63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbe9d8fc09f4d8cbf152def4a83d40b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.941376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1090/2189] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:15 2022] DELETE /identity/v3/users/abbe9d8fc09f4d8cbf152def4a83d40b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:15.957578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeaa5f2021be4efcb40e240105e54a86', 'request_id': 'req-704a15a0-461d-4b18-a37c-5d9aecee476e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.985475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] The token cache is being invalidate because project eeaa5f2021be4efcb40e240105e54a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:15.985957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.987002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-704a15a0-461d-4b18-a37c-5d9aecee476e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:15.990263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1100/2190] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:15 2022] DELETE /identity/v3/projects/eeaa5f2021be4efcb40e240105e54a86 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:16.005376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.006229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.006923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.045220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:16.048456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:16.192752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1091/2191] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:16.214579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.214985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.215354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.278043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:16.291014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:16.305232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1101/2192] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:16.306248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.322200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94689a53-f340-4cbb-ba1a-6c72746969cc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.328917 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.329555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.329832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.330163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.333786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:22:16.334150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:16.334923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:16.337575 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:16.359737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1092/2193] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:22:16.361357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.377660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0011b-a2ed-44f0-9705-d542b523420a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.384993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.386172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.386172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.386378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.387019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:16.389021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:16.540159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1102/2194] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:16.544060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.565624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a7275-ff49-48d7-aabe-6eaaeaa53fdd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.690707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.691397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.691778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.692060 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.693817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:16.696821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:16.838857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1093/2195] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:16 2022] POST /identity/v3/users => generated 287 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:16.844955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.860067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43d4b-bb00-4a7f-9e2e-1d742a5cfc49 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.870881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.872114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.873335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.873696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.874747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:16.883510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:16.901760 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1103/2196] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:16.908817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.926367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d19a-030c-44e6-8320-4ae7da2faded admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.937309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.939453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.939801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.940089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:16.941024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:16.943079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:16.965721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1094/2197] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:16.966116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:16.978884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626002f-09ee-4bdb-b885-9ba7167641cc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:16.985430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:16.986100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:16.986583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:16.986850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] PATH_INFO: `/v3/projects/2ab86a985b6943a2987321e7f2e5c340/users/b0f0ae0b057b4c4cadad0cd18c118a6c/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.006243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab86a985b6943a2987321e7f2e5c340, user_id=b0f0ae0b057b4c4cadad0cd18c118a6c, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:17.009212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0a947-8d40-466b-9ba4-33fa1dede5ea admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:17.107233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:17.108316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1104/2198] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:16 2022] PUT /identity/v3/projects/2ab86a985b6943a2987321e7f2e5c340/users/b0f0ae0b057b4c4cadad0cd18c118a6c/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:17.111703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:17.113564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:17.113848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:17.114404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.138402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbddb-842a-4e15-830d-05e489cacbb7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:17.158495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:17.160017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:17.310675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:17.313083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:17.313530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:17.313932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] PATH_INFO: `/v3/projects/bfe76e6ef99748b88892f977df3d1434` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.320669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe76e6ef99748b88892f977df3d1434)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:17.320669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:17.330485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1105/2199] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:17.341747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:17.344597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:17.452231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4280e-632e-4ccb-929a-a2f4aae348a7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:17.457230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:17.458563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:17.459006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:17.459689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.479986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:17.481975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6dcc-7ff4-46f8-b08c-8e2cd6fd74b9 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:17.507154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1106/2200] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:17.541657 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe76e6ef99748b88892f977df3d1434', 'request_id': 'req-1c3885a5-b110-4463-82ae-a1b0140d11ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:17.558665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe76e6ef99748b88892f977df3d1434', 'request_id': 'req-1c3885a5-b110-4463-82ae-a1b0140d11ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:17.699115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe76e6ef99748b88892f977df3d1434', 'request_id': 'req-1c3885a5-b110-4463-82ae-a1b0140d11ea'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:17.721674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] The token cache is being invalidate because project bfe76e6ef99748b88892f977df3d1434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:17.722138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:17.723331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1c3885a5-b110-4463-82ae-a1b0140d11ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:17.728315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1095/2201] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:17 2022] DELETE /identity/v3/projects/bfe76e6ef99748b88892f977df3d1434 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:17.736046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:17.736727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:17.737160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.774620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:17.777187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:17.917063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1107/2202] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:17.919377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:17.919862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:17.921715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:17.952425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:17.954567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:17.971727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1096/2203] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:17.979164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:17.995695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c8ca6-a831-445c-937c-6e6172342c8b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.004189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.004927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.006264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.007582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.008766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:22:18.009357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.012149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.030378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1108/2204] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:22:18.036242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:18.050885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb6cf6-88c2-46b7-8602-1738f65759b1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.059282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.060305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.061093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.063191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.068826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.068826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.254142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1097/2205] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:18 2022] POST /identity/v3/projects => generated 359 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:22:18.259408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:18.277712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8382f-6801-41d1-aed9-9f1ee28d9511 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.408777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.410263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.410715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.411225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.412563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.416313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.609014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1109/2206] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:18 2022] POST /identity/v3/users => generated 280 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:18.613362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:18.643433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a43d-b874-420c-a858-3ffed0e34a92 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.661953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.662851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.663228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.663596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.664818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.669270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.700179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1098/2207] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:18.701508 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:18.720090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b6a4-fd94-43b8-bee4-ae593622c345 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.737055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.742846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.743237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.743734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.746659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.751792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2a8eb-73e9-4f24-aea1-16c8c005fad7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.784217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1110/2208] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:18.785976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:18.804314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d487f4-db2b-4f26-ba18-43fc04f8de9c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:18.809871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:18.810659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.811053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.812051 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] PATH_INFO: `/v3/projects/698f44fe7c7c45409e9d8ce005cc48c3/users/6236607b3d904351aa6d38d398a29798/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:18.832295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698f44fe7c7c45409e9d8ce005cc48c3, user_id=6236607b3d904351aa6d38d398a29798, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:18.835458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:18.956164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1099/2209] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:18 2022] PUT /identity/v3/projects/698f44fe7c7c45409e9d8ce005cc48c3/users/6236607b3d904351aa6d38d398a29798/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:18.977615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:18.978478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:18.978478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:19.061410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] MFA Rules not processed for user `6236607b3d904351aa6d38d398a29798`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:19.063925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:19.273230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1111/2210] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:19.326266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:19.340509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:19.403695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:19.405403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:19.520417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f776898-d9aa-454c-9e10-3c531e0165d4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:19.527275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:19.528679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:19.529572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:19.530326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:19.544309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:19.546600 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:19.570757 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1100/2211] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:19.589309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:19.602552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2c92-df66-4408-8ae4-e9e334ef5576 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:19.610176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7930d0-36c7-404f-b1ec-0078b90de5cc service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:19.614104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:19.615406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:19.615891 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:19.616193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] PATH_INFO: `/v3/users/89bb70a2d4d5482f8e44caa96e060e75` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:19.617141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:19.617877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bb70a2d4d5482f8e44caa96e060e75)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:19.619310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:19.619902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:19.620199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] PATH_INFO: `/v3/users/6236607b3d904351aa6d38d398a29798` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:19.621030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:19.621489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6236607b3d904351aa6d38d398a29798)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:19.625559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:19.758065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:19.940784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6236607b3d904351aa6d38d398a29798'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:19.953360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bb70a2d4d5482f8e44caa96e060e75'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:19.962807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6236607b3d904351aa6d38d398a29798'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.031111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bb70a2d4d5482f8e44caa96e060e75'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.070727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bb70a2d4d5482f8e44caa96e060e75'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.071973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bb70a2d4d5482f8e44caa96e060e75'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.074727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d9108f6d-6a96-49c2-bf15-135149911057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bb70a2d4d5482f8e44caa96e060e75'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.104212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1112/2212] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:19 2022] DELETE /identity/v3/users/89bb70a2d4d5482f8e44caa96e060e75 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:20.106927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8355-9828-4e99-b7a1-4534a74b1b30 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.107407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8355-9828-4e99-b7a1-4534a74b1b30 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.107996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8355-9828-4e99-b7a1-4534a74b1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.143430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:20.145303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6236607b3d904351aa6d38d398a29798'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.146302 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6236607b3d904351aa6d38d398a29798'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.169835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9d95d322-709d-412c-986c-3f5b212f11c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6236607b3d904351aa6d38d398a29798'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:20.175116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a3cc8355-9828-4e99-b7a1-4534a74b1b30 None None] MFA Rules not processed for user `f37cab4f820446e0bcdb720c5867f6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:20.181200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a3cc8355-9828-4e99-b7a1-4534a74b1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.188709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1101/2213] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:22:19 2022] DELETE /identity/v3/users/6236607b3d904351aa6d38d398a29798 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:20.188709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145faa-6290-4913-b5a8-0c56631af5b6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.188709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145faa-6290-4913-b5a8-0c56631af5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.191202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72145faa-6290-4913-b5a8-0c56631af5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.234089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-72145faa-6290-4913-b5a8-0c56631af5b6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:20.239453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-72145faa-6290-4913-b5a8-0c56631af5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.345803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1113/2214] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:20.345803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.345803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.345803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.383546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:20.384894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.397951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1102/2215] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:20.400250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.400527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.400873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.453087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] MFA Rules not processed for user `b0f0ae0b057b4c4cadad0cd18c118a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:20.457290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.510838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1114/2216] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:20.512068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:20.513407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.533292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b58cb-bef6-4359-bb58-07f3e6d12222 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:20.540589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:20.542815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.543323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.544100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.545037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:20.548895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:20.620767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1103/2217] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:20.622470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:20.626314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.683789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1115/2218] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:20.684730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:20.687931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.754556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8db63-37cb-404c-9490-47c926044c37 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:20.782559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b79aa1-f9ba-4f9a-810c-1e26208abae5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:20.789558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:20.790876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.791339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.792058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.829693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:20.830901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.831353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.831860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.887844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:20.890480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:20.903981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1116/2219] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:20.906334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:20.908978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:20.929283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045885-79f0-4276-a8f0-3584e98dbd76 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:20.935742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:20.936650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:20.937316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:20.937672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:20.938548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:20.940737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:20.943524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:20.946739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:20.979846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1104/2220] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:20.981388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.003187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732201f-9c5c-4f27-bed5-9fb303878042 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.010225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.014270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.014270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.014270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.015009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.018995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.050487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1117/2221] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:21.052509 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.148391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1105/2222] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:20 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:21.154569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.165998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c7bf3-dff9-4a5a-8ecc-bc57c601754f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.172411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.173406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.173406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.173800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.174278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.175176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdca3-b505-4496-a7e5-5e341c301188 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.176340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.180605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.181340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.181722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.182098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.182986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.184741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.205918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1106/2223] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:21.207307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.218318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243221-515c-45ac-9ee4-873df02f0dad admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.224018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.224807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.225643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.225643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] PATH_INFO: `/v3/projects/17c2598f5b75495c9d6665854fbbf5b3/users/1c1013a1f39144668ff58b16e55bf0e3/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.255305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c2598f5b75495c9d6665854fbbf5b3, user_id=1c1013a1f39144668ff58b16e55bf0e3, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.259463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.306443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1118/2224] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:21 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:21.312076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.334909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270144cf-d098-47af-a394-00bcd0bdb925 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.343227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.344913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.345339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.345870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.347749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.349554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.365062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1119/2225] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:21.369318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.381396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260241b2-4370-40a0-ab32-6ca2cdcf0dd2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.386691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.387354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.387632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.388002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] PATH_INFO: `/v3/projects/ce0e4467ee0f4a82afcbffddf4647976/users/6a87d4f395a84298bda389eee504ad00/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.415176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0e4467ee0f4a82afcbffddf4647976, user_id=6a87d4f395a84298bda389eee504ad00, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.418010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.419176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1107/2226] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:21 2022] PUT /identity/v3/projects/17c2598f5b75495c9d6665854fbbf5b3/users/1c1013a1f39144668ff58b16e55bf0e3/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:21.424275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.566382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1120/2227] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:21 2022] PUT /identity/v3/projects/ce0e4467ee0f4a82afcbffddf4647976/users/6a87d4f395a84298bda389eee504ad00/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:21.568566 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.578174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f825-3aca-4e86-ae10-d0c478b1bba9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.678605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:21.741053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.746082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.746082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.746082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.757202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.759887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.796652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1108/2228] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:22:21.801663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:21.820353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee883c-85a5-4b41-ab39-8b88b9a71e63 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.827314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.829240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.829840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.830328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] PATH_INFO: `/v3/projects/17c2598f5b75495c9d6665854fbbf5b3/users/1c1013a1f39144668ff58b16e55bf0e3/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.834215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c2598f5b75495c9d6665854fbbf5b3, user_id=1c1013a1f39144668ff58b16e55bf0e3, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.843383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.866044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee89d-fdd9-4789-8750-1927465b691b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:21.877615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:21.879922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:21.885844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:21.885844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:21.885844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:21.890254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:21.918321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1109/2229] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:21 2022] PUT /identity/v3/projects/17c2598f5b75495c9d6665854fbbf5b3/users/1c1013a1f39144668ff58b16e55bf0e3/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:21.932542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1121/2230] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:21.948006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:22.078069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:22.099587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab1ed-6003-48a2-8b93-b44cde79425e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:22.105579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:22.106726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:22.107204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:22.107691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] PATH_INFO: `/v3/projects/ce0e4467ee0f4a82afcbffddf4647976/users/6a87d4f395a84298bda389eee504ad00/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:22.113081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0e4467ee0f4a82afcbffddf4647976, user_id=6a87d4f395a84298bda389eee504ad00, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:22.120359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:22.121859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:22.124236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:22.146653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd121-eb6d-4bb3-8dd3-b35afe61e6c6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:22.154385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1110/2231] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:21 2022] PUT /identity/v3/projects/ce0e4467ee0f4a82afcbffddf4647976/users/6a87d4f395a84298bda389eee504ad00/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:22.157781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:22.161474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:22.338972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67d50-335a-46cc-9d89-a9b3dba8886e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:22.351593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:22.352773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:22.353187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:22.354862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] PATH_INFO: `/v3/projects/f15b938653c644f8a90a5668a6665b36` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:22.355549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:22.356839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:22.358087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15b938653c644f8a90a5668a6665b36)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:22.359688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:22.362824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] PATH_INFO: `/v3/projects/698f44fe7c7c45409e9d8ce005cc48c3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:22.363318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:22.366249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698f44fe7c7c45409e9d8ce005cc48c3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:22.379111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:22.576962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15b938653c644f8a90a5668a6665b36', 'request_id': 'req-62867588-5c9b-45c7-b148-70b13e58e361'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.586077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15b938653c644f8a90a5668a6665b36', 'request_id': 'req-62867588-5c9b-45c7-b148-70b13e58e361'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.599504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698f44fe7c7c45409e9d8ce005cc48c3', 'request_id': 'req-0f2a5b93-5497-45fc-86ea-80f033c0a281'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.607662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698f44fe7c7c45409e9d8ce005cc48c3', 'request_id': 'req-0f2a5b93-5497-45fc-86ea-80f033c0a281'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.683257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15b938653c644f8a90a5668a6665b36', 'request_id': 'req-62867588-5c9b-45c7-b148-70b13e58e361'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.714620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] The token cache is being invalidate because project f15b938653c644f8a90a5668a6665b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:22.715596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.717074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-62867588-5c9b-45c7-b148-70b13e58e361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:22.721429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1111/2232] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:22 2022] DELETE /identity/v3/projects/f15b938653c644f8a90a5668a6665b36 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:22:23.229945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698f44fe7c7c45409e9d8ce005cc48c3', 'request_id': 'req-0f2a5b93-5497-45fc-86ea-80f033c0a281'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:23.250569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] The token cache is being invalidate because project 698f44fe7c7c45409e9d8ce005cc48c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:22:23.251253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:23.252355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0f2a5b93-5497-45fc-86ea-80f033c0a281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:22:23.254486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1122/2233] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:22:22 2022] DELETE /identity/v3/projects/698f44fe7c7c45409e9d8ce005cc48c3 => generated 0 bytes in 1134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:23.259697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:23.260278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:23.260278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:23.291782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:23.296568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:23.433868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1112/2234] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:23.438730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:23.439279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:23.439912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:23.498332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:23.502354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:23.518096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1123/2235] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:23.524804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:23.586821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad5284-e664-435c-96eb-8bd74a98ef8f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:23.597516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:23.599017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:23.600254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:23.600493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:23.602871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:22:23.603464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:23.609491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:23.645724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:23.655862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1113/2236] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:22:23.691949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702206d6-4929-405c-a0ae-e276cbd452ec None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:23.697473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:23.698413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:23.698906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:23.699379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:23.701106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:23.710092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:23.891934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1124/2237] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:22:23 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:23.897723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:23.916477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53794a6-5236-41e1-85f3-b124b0e1195e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:24.106096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:24.107475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.108753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.109446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.110857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:24.114615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:24.297504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1114/2238] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:22:23 2022] POST /identity/v3/users => generated 285 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:22:24.300368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:24.331917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37595440-34a3-4abb-abef-07981a12984e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:24.355501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:24.357442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.361808 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.362005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.362703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:24.365065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:24.394707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1125/2239] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:24.401112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:24.411102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:24.424938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26dba-a8ce-48cb-ba89-9d85f93145b9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:24.440095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:24.441133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.441480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.443981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.445567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:24.450905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce6b1-5dd4-4388-9420-6a9e0845c013 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:24.499046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:24.501151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1115/2240] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:22:24.516709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d530d-40dc-4113-ae3a-88c9d15eadfd admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:24.522573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:24.524542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.524542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.524542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] PATH_INFO: `/v3/projects/1b836d5f08364f098cfc12444f5ffbc2/users/e4a5795af6ad4d90bcfc9c35648e4a4b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.559410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b836d5f08364f098cfc12444f5ffbc2, user_id=e4a5795af6ad4d90bcfc9c35648e4a4b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:24.560461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04141072-569e-409c-9b7e-0e036acd2616 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:24.682693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1126/2241] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:22:24 2022] PUT /identity/v3/projects/1b836d5f08364f098cfc12444f5ffbc2/users/e4a5795af6ad4d90bcfc9c35648e4a4b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:22:24.685265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.685732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.686886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.744956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] MFA Rules not processed for user `e4a5795af6ad4d90bcfc9c35648e4a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:24.747688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:24.882952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1116/2242] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:24.885263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:24.885759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:24.886226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:24.897153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:24.900376 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:24.930700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] MFA Rules not processed for user `6a87d4f395a84298bda389eee504ad00`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:24.933412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:24.991184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d39c5f-9872-4fc3-af39-b8be926eee7a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:24.997948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:25.000398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:25.001080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:25.001369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:25.029115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:25.032505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afdd72-d18b-47c6-9482-034836803b35 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:25.056406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1117/2243] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:25.088148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:25.093357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1127/2244] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:22:25.106959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9754c-996e-4ed6-9c22-8c79052f3a75 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:25.106959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9754c-996e-4ed6-9c22-8c79052f3a75 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:25.107232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9754c-996e-4ed6-9c22-8c79052f3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:25.153716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c8f9754c-996e-4ed6-9c22-8c79052f3a75 None None] MFA Rules not processed for user `b0f0ae0b057b4c4cadad0cd18c118a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:25.156496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8f9754c-996e-4ed6-9c22-8c79052f3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:25.298753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1118/2245] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:25.313134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:25.317731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:25.494492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274c239-e0de-4d01-a8bc-c60f92e4f65c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:25.510406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:25.511165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:25.511451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:25.511721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:25.518963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:25.532271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:25.534006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:25.554346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1128/2246] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:22:26.891030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:27.439423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:29.144169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:29.564421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:31.919794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:32.463441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:33.457804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d05b59-35a4-4bcd-aa6b-01f2410bd270 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:33.458083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d05b59-35a4-4bcd-aa6b-01f2410bd270 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:33.458567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d05b59-35a4-4bcd-aa6b-01f2410bd270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:33.508332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d5d05b59-35a4-4bcd-aa6b-01f2410bd270 None None] MFA Rules not processed for user `1c1013a1f39144668ff58b16e55bf0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:33.512940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5d05b59-35a4-4bcd-aa6b-01f2410bd270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:33.598898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1119/2247] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:33.614763 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:33.616314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:33.632663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365f17-b8a0-4d72-8cfc-c9aee1aaea73 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:33.638839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:33.639663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:33.639981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:33.640248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:33.642480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:33.787103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:33.791525 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:33.798136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907c207-a855-4ced-95c6-d3cbd87b4d1a service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:33.814776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1129/2248] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:22:34.621192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:35.222449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:35.981205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:36.458964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:36.459244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:36.459516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:36.486049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] MFA Rules not processed for user `037e346bc69b44919d018e4aee4ae57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:36.487322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:36.575152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1120/2249] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:37.813355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:38.428671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:38.429545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:38.429545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:38.450495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] MFA Rules not processed for user `f37cab4f820446e0bcdb720c5867f6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:22:38.452442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:38.459783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1130/2250] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:22:42.095451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:48.444670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=54 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:53.046530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:22:53.049124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:22:53.141156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de3ddd-ccc5-4328-8df5-b91ddde81210 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:22:53.145272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:22:53.145958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:22:53.146236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:22:53.147097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:22:53.160840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:22:53.164339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231950f-0143-4500-93cf-86432210c170 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:22:53.175603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:22:53.184509 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1121/2251] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:22:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:23:12.914724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:13.002493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4052be-d77b-4cfb-a153-72b23f68fda8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:13.007449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:13.008169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:13.008440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:13.008706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] PATH_INFO: `/v3/users/e4a5795af6ad4d90bcfc9c35648e4a4b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:13.009870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a5795af6ad4d90bcfc9c35648e4a4b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:13.011842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:13.289881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a5795af6ad4d90bcfc9c35648e4a4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:13.379998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a5795af6ad4d90bcfc9c35648e4a4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:13.407982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a5795af6ad4d90bcfc9c35648e4a4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:13.409635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a5795af6ad4d90bcfc9c35648e4a4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:13.410747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a5795af6ad4d90bcfc9c35648e4a4b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:13.432032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1131/2252] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:23:12 2022] DELETE /identity/v3/users/e4a5795af6ad4d90bcfc9c35648e4a4b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:13.436423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:13.436978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:13.436978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:13.464064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:13.464943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:13.537402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1122/2253] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:13.547691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:13.549390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:13.620144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aaf62-3ad2-42f2-9f53-6ab29ab9a3ac admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:13.624849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:13.625646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:13.625929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:13.626202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:13.636661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:13.638669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0894d-b66f-458b-a818-e25270970daa service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:13.650135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1132/2254] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:23:14.332956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:14.336879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:14.375677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff341e5-9747-453b-9a6d-58fee5aa65ec None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:14.391960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:14.392998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:14.392998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:14.393812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] PATH_INFO: `/v3/projects/1b836d5f08364f098cfc12444f5ffbc2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:14.394466 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b836d5f08364f098cfc12444f5ffbc2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:14.396671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:14.600170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b836d5f08364f098cfc12444f5ffbc2', 'request_id': 'req-92d7bd70-565a-4673-8e2f-8fc87e6520d9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:14.608735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b836d5f08364f098cfc12444f5ffbc2', 'request_id': 'req-92d7bd70-565a-4673-8e2f-8fc87e6520d9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:14.843604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b836d5f08364f098cfc12444f5ffbc2', 'request_id': 'req-92d7bd70-565a-4673-8e2f-8fc87e6520d9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:14.861385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] The token cache is being invalidate because project 1b836d5f08364f098cfc12444f5ffbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:23:14.861938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:14.862859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92d7bd70-565a-4673-8e2f-8fc87e6520d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:14.864739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1123/2255] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:23:14 2022] DELETE /identity/v3/projects/1b836d5f08364f098cfc12444f5ffbc2 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:14.871874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:14.873227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:14.874388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:14.904802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:14.906213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:14.930923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:14.996041 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1133/2256] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:15.005636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.006196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.006718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.031696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:15.033083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:15.041776 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1124/2257] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:15.047129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.058564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc206a-af60-47b1-acee-bccd8a543832 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.063092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.063855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.064133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.064404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.065050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:23:15.065347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.066998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.082030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1134/2258] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:23:15.086414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.097042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7f0e6-fa55-4c68-bf03-42f91d3c9287 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.102670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.103324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.103595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.103886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.104513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.107123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.319885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1125/2259] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:23:15 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:23:15.322707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.338829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa63-d1b1-4b26-8bd0-de11abb51b1f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.437950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.442019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.442019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.442019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.442019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.442801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.614586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1135/2260] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:23:15 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:23:15.620398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.633905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75cad-c80e-4f41-a173-a44eab5fd640 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.641200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.641200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.641200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.641200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.641773 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.643408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.657298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1126/2261] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:23:15.663065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.674968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c0df9-1a20-45ef-93d9-209a418d34e2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.682851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.683493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.683786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.684093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.685040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.686491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d073-0193-42fc-96bb-6ed23e023b9b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.700896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1136/2262] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:23:15.705191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:15.716031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db150-5604-4cb1-a382-2b2470b75aaf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:15.721055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:15.721740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.722013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.722287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] PATH_INFO: `/v3/projects/7a1dad3dee3f4b9ab2f2432e6bceb1c7/users/ce06d86bc65642828d62b8a156613d88/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.742443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1dad3dee3f4b9ab2f2432e6bceb1c7, user_id=ce06d86bc65642828d62b8a156613d88, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:15.745257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:15.901030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1127/2263] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:23:15 2022] PUT /identity/v3/projects/7a1dad3dee3f4b9ab2f2432e6bceb1c7/users/ce06d86bc65642828d62b8a156613d88/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:15.912607 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:15.913169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:15.913169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:15.946739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] MFA Rules not processed for user `ce06d86bc65642828d62b8a156613d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:15.948398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:16.034545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1137/2264] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:16.051216 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:16.053046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:16.081873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:16.125856 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869b61-8dcf-4a88-ad13-3395f7c19b8b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:16.130484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:16.131109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:16.131380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:16.131649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:16.156581 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:16.159346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:16.177380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1128/2265] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:23:26.814558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:27.836598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=17 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:29.249962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:29.251522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:29.320743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcc11e-ff03-4bde-a97c-05f2cca7e378 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:29.324532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:29.328869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:29.328869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:29.328869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:29.328869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:29.398439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:29.399816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:29.411553 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1138/2266] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:23:32.494468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:32.579013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebddf2-66fb-4e0c-9287-8fe3f4dfe162 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:32.585841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:32.586063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:32.586507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:32.586847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] PATH_INFO: `/v3/users/ce06d86bc65642828d62b8a156613d88` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:32.588335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce06d86bc65642828d62b8a156613d88)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:32.591340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:32.955519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:32.958648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:32.981903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce06d86bc65642828d62b8a156613d88'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:32.982951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512ad9a-1072-4900-9cb0-3c895f1ac3e8 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:32.993705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce06d86bc65642828d62b8a156613d88'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.001728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:33.002900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:33.003401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:33.003988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] PATH_INFO: `/v3/users/b0f0ae0b057b4c4cadad0cd18c118a6c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:33.006001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f0ae0b057b4c4cadad0cd18c118a6c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:33.009053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:33.116890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce06d86bc65642828d62b8a156613d88'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.117861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce06d86bc65642828d62b8a156613d88'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.139864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddc85fc4-1bd2-41b8-94a6-8b67792d2437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce06d86bc65642828d62b8a156613d88'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.151327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1129/2267] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:23:32 2022] DELETE /identity/v3/users/ce06d86bc65642828d62b8a156613d88 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:33.165425 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796369-9439-40cc-9448-af9929a948ab None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:33.165708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796369-9439-40cc-9448-af9929a948ab None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:33.166148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796369-9439-40cc-9448-af9929a948ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:33.190439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a0796369-9439-40cc-9448-af9929a948ab None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:33.192257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a0796369-9439-40cc-9448-af9929a948ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:33.280328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1130/2268] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:33.292157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796369-9439-40cc-9448-af9929a948ab None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:33.302404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a0796369-9439-40cc-9448-af9929a948ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:33.326343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:33.366377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796369-9439-40cc-9448-af9929a948ab None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:33.368857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f0ae0b057b4c4cadad0cd18c118a6c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.370892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:33.372122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:33.372403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:33.372676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:33.382621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:33.384150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:33.394645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1131/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:23:33.521078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f0ae0b057b4c4cadad0cd18c118a6c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.537011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f0ae0b057b4c4cadad0cd18c118a6c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.537672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f0ae0b057b4c4cadad0cd18c118a6c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.538296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f0ae0b057b4c4cadad0cd18c118a6c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:33.562777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1139/2270] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:23:32 2022] DELETE /identity/v3/users/b0f0ae0b057b4c4cadad0cd18c118a6c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:33.958312 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:33.965563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:33.965848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:33.965848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:33.973945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecfe51-c816-4072-a2cb-89a8c158b9ca service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:34.001192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:34.052538 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e767-e85d-4cf5-bc77-047d15d748d2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:34.058223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:34.059377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:34.059659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:34.060094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] PATH_INFO: `/v3/projects/2ab86a985b6943a2987321e7f2e5c340` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:34.060528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:34.061299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab86a985b6943a2987321e7f2e5c340)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:34.061490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:34.061862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:34.062235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] PATH_INFO: `/v3/projects/7a1dad3dee3f4b9ab2f2432e6bceb1c7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:34.063306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:34.063580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1dad3dee3f4b9ab2f2432e6bceb1c7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:34.065640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:34.220668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab86a985b6943a2987321e7f2e5c340', 'request_id': 'req-67300a68-7186-4755-84aa-b4362ddc9bc1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.226256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1dad3dee3f4b9ab2f2432e6bceb1c7', 'request_id': 'req-e53cb24f-7025-4db4-b220-c71750ebc5dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.229907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab86a985b6943a2987321e7f2e5c340', 'request_id': 'req-67300a68-7186-4755-84aa-b4362ddc9bc1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.236267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1dad3dee3f4b9ab2f2432e6bceb1c7', 'request_id': 'req-e53cb24f-7025-4db4-b220-c71750ebc5dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.361053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab86a985b6943a2987321e7f2e5c340', 'request_id': 'req-67300a68-7186-4755-84aa-b4362ddc9bc1'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.381401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] The token cache is being invalidate because project 2ab86a985b6943a2987321e7f2e5c340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:23:34.381831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.382691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.384814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1140/2271] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:23:33 2022] DELETE /identity/v3/projects/2ab86a985b6943a2987321e7f2e5c340 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:23:34.391088 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:34.394652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:34.473527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300a68-7186-4755-84aa-b4362ddc9bc1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:34.503559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1dad3dee3f4b9ab2f2432e6bceb1c7', 'request_id': 'req-e53cb24f-7025-4db4-b220-c71750ebc5dc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.516904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] The token cache is being invalidate because project 7a1dad3dee3f4b9ab2f2432e6bceb1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:23:34.517247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.520262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.522046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1132/2272] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:23:33 2022] DELETE /identity/v3/projects/7a1dad3dee3f4b9ab2f2432e6bceb1c7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:23:34.539532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:34.540498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:34.540767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:34.541038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] PATH_INFO: `/v3/users/6a87d4f395a84298bda389eee504ad00` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:34.544056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a87d4f395a84298bda389eee504ad00)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:34.549376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:34.549376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:34.845112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a87d4f395a84298bda389eee504ad00'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.949856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a87d4f395a84298bda389eee504ad00'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.963631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a87d4f395a84298bda389eee504ad00'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.964468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a87d4f395a84298bda389eee504ad00'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.965477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5ed4f049-13fc-4ff1-8b73-003c7b25f4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a87d4f395a84298bda389eee504ad00'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:34.979082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1141/2273] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:23:34 2022] DELETE /identity/v3/users/6a87d4f395a84298bda389eee504ad00 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:23:35.288440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:35.288440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:35.300700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb24f-7025-4db4-b220-c71750ebc5dc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:35.361324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:35.370983 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:35.372357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:35.372629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:35.372894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] PATH_INFO: `/v3/projects/ce0e4467ee0f4a82afcbffddf4647976` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:35.374146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0e4467ee0f4a82afcbffddf4647976)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:35.376115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:35.551685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0e4467ee0f4a82afcbffddf4647976', 'request_id': 'req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:35.557931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0e4467ee0f4a82afcbffddf4647976', 'request_id': 'req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:35.675475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0e4467ee0f4a82afcbffddf4647976', 'request_id': 'req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:35.687994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] The token cache is being invalidate because project ce0e4467ee0f4a82afcbffddf4647976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:23:35.688317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:35.689015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94275c59-a5a8-4d36-b6bf-41a2f2e249ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:23:35.691272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1133/2274] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:23:35 2022] DELETE /identity/v3/projects/ce0e4467ee0f4a82afcbffddf4647976 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:35.697228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:35.697554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:35.697936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:35.724317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:35.725821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:35.814645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1142/2275] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:35.823298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:35.823584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:35.823895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:35.847696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:35.848955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:35.858236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1134/2276] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:23:35.862008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:35.873790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842cbe-ed08-47f1-a00d-1cc6d88783e9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:35.878827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:35.879440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:35.879715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:35.880029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:35.880708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:23:35.881004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:35.882635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:35.896885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1143/2277] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:23:35.903069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:35.914733 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf9c1-a60a-4309-bee4-3a810ea83c50 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:35.922101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:35.926045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:35.926045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:35.926045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:35.926045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:35.928288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.074279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1135/2278] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:23:35 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:23:36.077475 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:36.088614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d25c8-5348-4ebd-8b9f-b05ee9ac5f04 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:36.169745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:36.170363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.170641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.170914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.171546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:36.173650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.185985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:36.361501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1144/2279] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:23:36 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:23:36.361881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:36.373892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77df54-cb1c-4b6c-a1f5-65589a8c0f7a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:36.378783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:36.379391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.379667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.379970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.380611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:36.382221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.394364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1136/2280] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:23:36.400811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:36.412592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8807-e2e2-4727-804f-93a81b6bd05a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:36.417226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:36.417856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.418134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.418400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.419038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:36.420702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54744cac-4968-44e4-995e-3afd014a8bb4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.433300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1145/2281] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:23:36.440044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:36.451411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b291-bf59-411c-8618-76a374644ab7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:36.456327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:36.519507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.519507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.519507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] PATH_INFO: `/v3/projects/6f5421e2b994470094d2f723097e1020/users/2337a29d214b4c00ba9721f396f8d5ee/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.519507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5421e2b994470094d2f723097e1020, user_id=2337a29d214b4c00ba9721f396f8d5ee, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:36.519507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.727238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1137/2282] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:23:36 2022] PUT /identity/v3/projects/6f5421e2b994470094d2f723097e1020/users/2337a29d214b4c00ba9721f396f8d5ee/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:23:36.739314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752bb7-d4fe-42f6-990f-e62dcc74e270 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.739699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752bb7-d4fe-42f6-990f-e62dcc74e270 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.740036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752bb7-d4fe-42f6-990f-e62dcc74e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.771799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e6752bb7-d4fe-42f6-990f-e62dcc74e270 None None] MFA Rules not processed for user `2337a29d214b4c00ba9721f396f8d5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:36.773230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e6752bb7-d4fe-42f6-990f-e62dcc74e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:36.857382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1146/2283] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:36.870249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:36.873538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:36.941496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264e8e9-6035-4362-93d6-4f8b793e2977 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:36.945399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:36.946118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:36.946441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:36.946551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:36.957100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:36.962722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:36.974074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1138/2284] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:23:46.859592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=39 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:46.965414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:23:50.432340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:50.432906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:50.432906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:50.456481 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] MFA Rules not processed for user `bf2cab4aebe54e44aff07c25182b8663`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:23:50.457762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:50.533358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1147/2285] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:23:53.507633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:23:53.509752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:53.587469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41af2f-f896-4b96-92ee-325e8de1fa76 service glance] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:23:53.593542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:23:53.594150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:23:53.594441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:23:53.594852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:23:53.596943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:23:53.610236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:23:53.611958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1edb3-546a-4fe1-ab5f-cf0b3566324f service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:23:53.623663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1139/2286] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:23:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:24:00.522307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=25 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:03.619545 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=32 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:04.502942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:04.573287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6fb69-5645-4c21-a416-925451a3a542 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:04.578227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:04.578859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:04.579131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:04.579397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] PATH_INFO: `/v3/users/2337a29d214b4c00ba9721f396f8d5ee` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:04.580969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2337a29d214b4c00ba9721f396f8d5ee)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:04.582537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:04.841398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2337a29d214b4c00ba9721f396f8d5ee'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:04.973897 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2337a29d214b4c00ba9721f396f8d5ee'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:04.988732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2337a29d214b4c00ba9721f396f8d5ee'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:04.989956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2337a29d214b4c00ba9721f396f8d5ee'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:04.990900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2337a29d214b4c00ba9721f396f8d5ee'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:05.016604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1148/2287] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:24:04 2022] DELETE /identity/v3/users/2337a29d214b4c00ba9721f396f8d5ee => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:05.021354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:05.022199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:05.022385 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:05.045005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:05.047072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:05.118815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1140/2288] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:24:05.129201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:05.130739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:05.198141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74384541-fd48-49f5-88b6-a4093321e796 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:05.203080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:05.203697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:05.204002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:05.204271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:05.214422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:05.215816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4010a-622a-4133-b833-2099c4bb163d service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:05.234993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1149/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:24:05.876184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:05.877031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:05.894916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179ced-6e79-4889-a355-55ba0d88470e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:05.900307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:05.900975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:05.901303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:05.901587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] PATH_INFO: `/v3/projects/6f5421e2b994470094d2f723097e1020` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:05.902959 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5421e2b994470094d2f723097e1020)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:05.905831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:06.130593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5421e2b994470094d2f723097e1020', 'request_id': 'req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:06.138831 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5421e2b994470094d2f723097e1020', 'request_id': 'req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:06.424700 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5421e2b994470094d2f723097e1020', 'request_id': 'req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:06.436761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] The token cache is being invalidate because project 6f5421e2b994470094d2f723097e1020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:24:06.446563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:06.446563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-03b49073-3edf-4f5a-8ab7-4343e8e98f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:06.446563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1141/2290] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:24:05 2022] DELETE /identity/v3/projects/6f5421e2b994470094d2f723097e1020 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:06.446933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:06.446933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:06.446933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:06.466922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:06.468345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:06.488860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:06.568387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1150/2291] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:06.577003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:06.577283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:06.577548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:06.598620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:06.600537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:06.612139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1142/2292] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:06.619139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:06.630952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09670a51-632b-49d2-80c5-b88a1077e7fc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:06.635862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:06.636547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:06.636900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:06.637167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:06.638766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:24:06.639061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:06.640814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:06.654324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1151/2293] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:24:06.669007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:06.679891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d03f-ff5e-4e8f-810b-242d4bd0ec97 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:06.685454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:06.686085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:06.686362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:06.686635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:06.687276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:06.689238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:06.871740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1143/2294] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:24:06 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:24:06.876807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:06.889019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d1a8-b203-4393-a16a-8df15a21ac87 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:06.977263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:06.978202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:06.978385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:06.979133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:06.980580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:06.982986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:07.101163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1152/2295] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:24:06 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:24:07.105398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:07.125541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51080fc-6a3d-4b9d-bfab-56e9d9de4fbe admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:07.132135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:07.132828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.133024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.134094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.134094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:07.136721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:07.159043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1144/2296] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:24:07.160947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:07.180131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2964426-ff58-4a06-b4d0-38c753414206 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:07.186709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:07.187366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.187644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.188132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.188742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:07.190426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a65913-d223-4571-9683-5a4dd0884c6f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:07.202782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1153/2297] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:24:07.207923 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:07.225446 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf012f-9e62-417a-ae67-b790817ed6f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:07.232602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:07.233693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.234161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.234467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] PATH_INFO: `/v3/projects/62958b4ca9a64c718a3ddec1a55cdca4/users/f9aa82d3566f459fa5d33a5972f3517e/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.261127 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62958b4ca9a64c718a3ddec1a55cdca4, user_id=f9aa82d3566f459fa5d33a5972f3517e, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:07.266204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:07.391619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1145/2298] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:24:07 2022] PUT /identity/v3/projects/62958b4ca9a64c718a3ddec1a55cdca4/users/f9aa82d3566f459fa5d33a5972f3517e/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:24:07.461829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.462451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.462451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.493335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] MFA Rules not processed for user `f9aa82d3566f459fa5d33a5972f3517e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:07.494557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:07.582708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1154/2299] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:07.587012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:07.614522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:07.686985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd969-3af9-415f-aeb9-b8178fd1a6b3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:07.694392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:07.695175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.695555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.696039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.696778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:07.698897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:07.866954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1146/2300] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:24:07 2022] POST /identity/v3/projects => generated 367 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:24:07.871512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:07.884572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530d50-ab97-4b70-b5ad-5df16b8a194f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:07.913453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:07.948201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:07.948846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:07.949126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:07.949398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:07.950639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:07.952633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.073183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1155/2301] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:24:07 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:24:08.074527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:08.086718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90935c81-29ec-4072-ac9e-f650868b0b6e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:08.093071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:08.093782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.094079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.094364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.095009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:08.096882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.112596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1147/2302] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:24:08.114434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:08.126723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949989fd-c31b-4a64-8720-64a7973982f4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:08.132485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:08.133257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.133652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.134036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] PATH_INFO: `/v3/projects/01b40c5b70cd476eba50ba68bcc2d484/users/a108d35bcc8041d5b9bc338686453fb2/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.151656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b40c5b70cd476eba50ba68bcc2d484, user_id=a108d35bcc8041d5b9bc338686453fb2, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:08.155364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.299712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1156/2303] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:24:08 2022] PUT /identity/v3/projects/01b40c5b70cd476eba50ba68bcc2d484/users/a108d35bcc8041d5b9bc338686453fb2/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:08.304854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:08.316249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2193d4-7a58-464c-8e2a-17555983b841 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:08.389402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:08.390012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.390287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.390578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.391180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:08.392874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f0b36-de04-4eb3-8b87-cdc0c1374813 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.403565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1148/2304] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:24:08.409565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:08.420775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284ced5-b2aa-4213-896a-a6558dabc623 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:08.427099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:08.427790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.428144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.428378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] PATH_INFO: `/v3/projects/01b40c5b70cd476eba50ba68bcc2d484/users/a108d35bcc8041d5b9bc338686453fb2/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.430334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b40c5b70cd476eba50ba68bcc2d484, user_id=a108d35bcc8041d5b9bc338686453fb2, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:08.433032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.444818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1157/2305] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:24:08 2022] PUT /identity/v3/projects/01b40c5b70cd476eba50ba68bcc2d484/users/a108d35bcc8041d5b9bc338686453fb2/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:08.456131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.456418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.456696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.488123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] MFA Rules not processed for user `a108d35bcc8041d5b9bc338686453fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:08.489257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:08.574544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1149/2306] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:08.586156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:08.587957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:08.649040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b99bc-b22b-4f5f-a3c3-caef75f1d31f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:08.652787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:08.653569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:08.653854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:08.654299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:08.719309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:08.720990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ab4b4-f5d5-4192-a3ad-bba338d3d342 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:08.736049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1158/2307] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:24:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:24:13.152116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:13.171293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:13.233341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f405733-0f0e-426e-8279-bc73b9f9c711 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:13.240709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:13.242779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:13.244407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:13.244751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] PATH_INFO: `/v3/users/f9aa82d3566f459fa5d33a5972f3517e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:13.250896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9aa82d3566f459fa5d33a5972f3517e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:13.254876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:13.526751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9aa82d3566f459fa5d33a5972f3517e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:13.536038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9aa82d3566f459fa5d33a5972f3517e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:13.628800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9aa82d3566f459fa5d33a5972f3517e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:13.629601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9aa82d3566f459fa5d33a5972f3517e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:13.653141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9aa82d3566f459fa5d33a5972f3517e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:13.667151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1150/2308] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:24:13 2022] DELETE /identity/v3/users/f9aa82d3566f459fa5d33a5972f3517e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:13.671529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:13.672317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:13.672317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:13.697445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:13.699463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:13.738080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:13.801869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1159/2309] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:24:13.814843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:13.816609 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:13.929409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4394-81ad-4bca-a5b2-590e4665e09f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:13.934606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:13.935635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:13.935635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:13.935975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:13.949561 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:13.952134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:13.967197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1151/2310] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:24:14.613135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:14.616346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:14.632805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871dc20-fd58-4d1f-adae-c27f44fe6323 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:14.640203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:14.641726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:14.641726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:14.641726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] PATH_INFO: `/v3/projects/62958b4ca9a64c718a3ddec1a55cdca4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:14.643011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62958b4ca9a64c718a3ddec1a55cdca4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:14.645091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:14.788719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62958b4ca9a64c718a3ddec1a55cdca4', 'request_id': 'req-c48d392b-bc65-4a91-a17f-4a247679c40f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:14.796272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62958b4ca9a64c718a3ddec1a55cdca4', 'request_id': 'req-c48d392b-bc65-4a91-a17f-4a247679c40f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:14.909683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62958b4ca9a64c718a3ddec1a55cdca4', 'request_id': 'req-c48d392b-bc65-4a91-a17f-4a247679c40f'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:14.922842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] The token cache is being invalidate because project 62958b4ca9a64c718a3ddec1a55cdca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:24:14.923126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:14.923805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:14.925469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1160/2311] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:24:14 2022] DELETE /identity/v3/projects/62958b4ca9a64c718a3ddec1a55cdca4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:14.929571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:14.939525 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95ffe6-df84-40f6-acf3-0bb423a88d27 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:14.976142 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:15.002810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:15.003536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:15.003892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:15.004204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] PATH_INFO: `/v3/users/a108d35bcc8041d5b9bc338686453fb2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:15.005405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a108d35bcc8041d5b9bc338686453fb2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:15.007508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:15.254555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a108d35bcc8041d5b9bc338686453fb2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:15.261745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a108d35bcc8041d5b9bc338686453fb2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:15.361157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a108d35bcc8041d5b9bc338686453fb2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:15.361896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a108d35bcc8041d5b9bc338686453fb2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:15.377388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29f119a6-8e2c-4867-a5e2-9316439fe685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a108d35bcc8041d5b9bc338686453fb2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:15.383349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1152/2312] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:24:14 2022] DELETE /identity/v3/users/a108d35bcc8041d5b9bc338686453fb2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:15.878568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:15.880062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:15.895849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d392b-bc65-4a91-a17f-4a247679c40f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:15.968193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:15.968829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:15.969108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:15.969379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] PATH_INFO: `/v3/projects/01b40c5b70cd476eba50ba68bcc2d484` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:15.970552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b40c5b70cd476eba50ba68bcc2d484)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:15.972518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.089597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b40c5b70cd476eba50ba68bcc2d484', 'request_id': 'req-a0d4a740-125b-42a2-a0f1-417638990acf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:16.090745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:16.098574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b40c5b70cd476eba50ba68bcc2d484', 'request_id': 'req-a0d4a740-125b-42a2-a0f1-417638990acf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:16.178806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b40c5b70cd476eba50ba68bcc2d484', 'request_id': 'req-a0d4a740-125b-42a2-a0f1-417638990acf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:16.192872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] The token cache is being invalidate because project 01b40c5b70cd476eba50ba68bcc2d484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:24:16.193362 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:16.194334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a0d4a740-125b-42a2-a0f1-417638990acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:16.196430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1161/2313] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:24:15 2022] DELETE /identity/v3/projects/01b40c5b70cd476eba50ba68bcc2d484 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:24:16.204612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.205371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.205583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.232973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:16.235432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:16.308616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1153/2314] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:16.316978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.317306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.317665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.346516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:16.347806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:16.356166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1162/2315] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:16.362069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.378347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19d47-50dd-4c7d-8efb-6a7a886f7377 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.383115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.383715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.384012 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.384284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.384954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:24:16.385252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.386872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.400193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1154/2316] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:24:16.405583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.416288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94fa62-1ec8-4c78-9f56-761a292c1584 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.421665 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.422268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.422528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.422981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.423408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.425426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.512971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1163/2317] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:24:16 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:24:16.517548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.529279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786aa8-6301-444e-a756-9eacffcba03f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.582648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:16.601230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.601836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.602117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.602387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.603027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.605029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.728546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1155/2318] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:24:16 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:24:16.733991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.744669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a81ed-7e10-4839-84fc-8c106e253012 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.750516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.751115 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.751390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.751655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.752331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.753941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.766563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1164/2319] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:24:16.771317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.783253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32172d8-0b9a-46b5-b3a1-2d56394496cf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.789768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.790857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.791403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.791884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.793071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.797147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321919-231a-42f1-b5f9-1d18e55c1f89 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.809333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1156/2320] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:24:16.813697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:16.832440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27401b-6f0f-4578-971c-d77fd0b9bd95 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:16.837490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:16.838149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.838424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.838696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] PATH_INFO: `/v3/projects/f66b6145ab944dbf9f9e10209f30ffad/users/e4a8608b0d964ca3a5ed90c5ddee5424/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.855470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66b6145ab944dbf9f9e10209f30ffad, user_id=e4a8608b0d964ca3a5ed90c5ddee5424, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:16.859286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:16.927567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1165/2321] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:24:16 2022] PUT /identity/v3/projects/f66b6145ab944dbf9f9e10209f30ffad/users/e4a8608b0d964ca3a5ed90c5ddee5424/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:16.940282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7acdd-6b4b-4b5f-9302-61367d5d17b6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:16.940564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7acdd-6b4b-4b5f-9302-61367d5d17b6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:16.940817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7acdd-6b4b-4b5f-9302-61367d5d17b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:16.973144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-70e7acdd-6b4b-4b5f-9302-61367d5d17b6 None None] MFA Rules not processed for user `e4a8608b0d964ca3a5ed90c5ddee5424`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:16.974363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70e7acdd-6b4b-4b5f-9302-61367d5d17b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:17.045662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1157/2322] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:17.057713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:17.059565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:17.122134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e11d75-615d-4c75-b9c4-1965357c4b94 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:17.125955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:17.126561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:17.126839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:17.127137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:17.136073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:17.138028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3203d-8a2c-4212-97d2-fdf779d2dc08 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:17.147386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1166/2323] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:24:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:24:20.016598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:20.017160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:20.017160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:20.036689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] MFA Rules not processed for user `e4a8608b0d964ca3a5ed90c5ddee5424`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:20.037898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:20.045721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1158/2324] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:27.143160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=59,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:30.031507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:46.019416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f431-0d2c-4899-a220-61b56d76427d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:46.020036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f431-0d2c-4899-a220-61b56d76427d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:46.020036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f431-0d2c-4899-a220-61b56d76427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:46.045531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4212f431-0d2c-4899-a220-61b56d76427d None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:46.046762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4212f431-0d2c-4899-a220-61b56d76427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:46.117203 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1167/2325] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:46.165919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:46.169236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:46.268794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf08180-fc5b-4882-b067-d608aaa9fe8b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:46.274246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:46.277247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:46.277247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:46.277247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:46.285445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:46.287038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:46.295896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1159/2326] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:24:47.293630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1e10-d2ba-452e-b8b8-f9a07e2f967f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:47.294219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1e10-d2ba-452e-b8b8-f9a07e2f967f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:47.294503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1e10-d2ba-452e-b8b8-f9a07e2f967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:47.318500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3e1d1e10-d2ba-452e-b8b8-f9a07e2f967f None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:47.320698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3e1d1e10-d2ba-452e-b8b8-f9a07e2f967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:47.328391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1168/2327] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:47.342471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:47.366577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff775145-d094-4e8c-82ff-098f9b1af929 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:47.379656 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:47.380791 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:47.381395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:47.381930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:47.399851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:47.401832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:47.413598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1160/2328] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:24:48.227945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1979aa-6ed7-4928-abe8-1d5b2e5de869 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:48.228436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1979aa-6ed7-4928-abe8-1d5b2e5de869 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:48.228917 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1979aa-6ed7-4928-abe8-1d5b2e5de869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:48.254686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ae1979aa-6ed7-4928-abe8-1d5b2e5de869 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:48.255952 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ae1979aa-6ed7-4928-abe8-1d5b2e5de869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:48.263894 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1169/2329] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:24:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:48.277033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:48.288297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98dcaf-63f9-4778-ae80-85b15f6d181a service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:48.294232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:48.294893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:48.295186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:48.295462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:48.304494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:48.306070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:48.315037 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1161/2330] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:24:49.126931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:49.127507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:49.127507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:49.147419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:49.148641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:49.156618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1170/2331] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:24:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:49.170845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:49.181684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650a522-374f-4b29-91f5-93bb5d840a5e service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:49.187457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:49.188177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:49.188464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:49.188735 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:49.197476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:49.200017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a318421-d524-40f3-8e17-db6373e3482a service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:49.208934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1162/2332] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:24:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:24:52.618631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:52.698080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ceb4e-7758-4eb8-886b-01b5c30a6102 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:52.702944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:52.703591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:52.703903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:52.704194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] PATH_INFO: `/v3/users/e4a8608b0d964ca3a5ed90c5ddee5424` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:52.705372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a8608b0d964ca3a5ed90c5ddee5424)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:52.707312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:53.212771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a8608b0d964ca3a5ed90c5ddee5424'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:53.338107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a8608b0d964ca3a5ed90c5ddee5424'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:53.360056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a8608b0d964ca3a5ed90c5ddee5424'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:53.361429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a8608b0d964ca3a5ed90c5ddee5424'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:53.362068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a8608b0d964ca3a5ed90c5ddee5424'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:53.378090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1171/2333] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:24:52 2022] DELETE /identity/v3/users/e4a8608b0d964ca3a5ed90c5ddee5424 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:53.382745 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:53.383625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:53.383949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:53.413091 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:53.415409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:53.510191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1163/2334] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:53.522989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:53.524783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:53.533710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:53.600140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2eee2-49b8-4572-83dd-e1201e95c633 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:53.604066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:53.604750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:53.605023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:53.605291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:53.618605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:53.621552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496d0e-7e1e-4b3b-8a0c-dae24514817f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:53.632663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1172/2335] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:24:54.102215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:54.103779 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:54.117242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399e894-e5df-452f-85c3-47d424fa123f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:54.124405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:54.125551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:54.126031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:54.126361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] PATH_INFO: `/v3/projects/f66b6145ab944dbf9f9e10209f30ffad` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:54.127582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66b6145ab944dbf9f9e10209f30ffad)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:54.129557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:54.445170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:24:54.448220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66b6145ab944dbf9f9e10209f30ffad', 'request_id': 'req-bce08b3b-df68-4381-bc21-5981012a400e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:54.455305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66b6145ab944dbf9f9e10209f30ffad', 'request_id': 'req-bce08b3b-df68-4381-bc21-5981012a400e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:54.810943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66b6145ab944dbf9f9e10209f30ffad', 'request_id': 'req-bce08b3b-df68-4381-bc21-5981012a400e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:54.824310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] The token cache is being invalidate because project f66b6145ab944dbf9f9e10209f30ffad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:24:54.824586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:54.825280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:24:54.827167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1164/2336] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:24:54 2022] DELETE /identity/v3/projects/f66b6145ab944dbf9f9e10209f30ffad => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:24:59.132776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:59.133328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:59.133427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:59.154984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:24:59.156313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:59.232902 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1173/2337] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:24:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:24:59.248189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:24:59.250263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:24:59.336893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce08b3b-df68-4381-bc21-5981012a400e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:24:59.344209 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:24:59.344747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:24:59.345022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:24:59.345294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:24:59.355265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:24:59.356938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:24:59.366189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1165/2338] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:25:09.224705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=49 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:09.362390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=4,keystone:SELECT=39,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:10.484848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:10.487279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:10.578818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be1068-d98b-4a99-bb7d-b4a0c9dc4aca None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:10.586045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:10.586874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:10.587151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:10.587422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:10.589471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:10.689943 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:10.692023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a4fce-d611-4da0-a2cc-0a2268115a94 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:10.705909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1174/2339] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:14.377611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:14.389710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c88f8-4c39-44f3-9c46-f18e551b900b service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:14.395133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:14.396026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:14.396379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:14.396717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:14.398736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:14.416430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:14.421129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:14.431615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1166/2340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:20.700198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=54 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:22.152971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026545-5414-420e-b641-6f6e04fd237d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:22.152971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026545-5414-420e-b641-6f6e04fd237d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:22.152971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026545-5414-420e-b641-6f6e04fd237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:22.178333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-af026545-5414-420e-b641-6f6e04fd237d None None] MFA Rules not processed for user `037e346bc69b44919d018e4aee4ae57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:22.179639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-af026545-5414-420e-b641-6f6e04fd237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:22.238440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1175/2341] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:22.432277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:22.441535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8309c51-4b56-4fc3-9fbe-f62d39ac867a service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:22.445420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:22.446027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:22.446301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:22.446569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:22.448327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:22.458952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:22.460411 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543d667-1014-419b-bf46-942a114b515c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:22.469651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1167/2342] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:22.999945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.000987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.001134 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.003814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1176/2343] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:25:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:25:23.013295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7da8-6d5e-44bc-b0f7-3fdb1dd7a47b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.014631 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7da8-6d5e-44bc-b0f7-3fdb1dd7a47b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.015182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a7da8-6d5e-44bc-b0f7-3fdb1dd7a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.048769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f03a7da8-6d5e-44bc-b0f7-3fdb1dd7a47b None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:23.050513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f03a7da8-6d5e-44bc-b0f7-3fdb1dd7a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:23.060692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1168/2344] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:23.072541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:23.074661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:23.140596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08c7b9-8a5c-4a03-9921-d45c261abecf None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:23.144885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:23.145769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.146137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.146496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.158558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:23.160053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d556a-4a32-4673-a26c-c969aa410629 service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:23.172428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1177/2345] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:23.556503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.557066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.557066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.558577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1169/2346] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:25:23.564809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf1bc-26cf-49c2-a4af-4d35d035d483 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.569160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf1bc-26cf-49c2-a4af-4d35d035d483 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.569160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf1bc-26cf-49c2-a4af-4d35d035d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.594703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8e3bf1bc-26cf-49c2-a4af-4d35d035d483 None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:23.596018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8e3bf1bc-26cf-49c2-a4af-4d35d035d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:23.603286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1178/2347] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:23.617081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:23.618816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:23.632947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ea82-681c-48d6-ba2f-127b42041c1c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:23.636427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:23.637058 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.637374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.637644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.646586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:23.648061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596ff1-559b-46f3-9526-73ff9f4f13fd service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:23.656998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1170/2348] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:23.753150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60be2-4e4e-41f7-8a7d-b3eb018af175 None None] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.753520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60be2-4e4e-41f7-8a7d-b3eb018af175 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.753931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60be2-4e4e-41f7-8a7d-b3eb018af175 None None] PATH_INFO: `/` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.756251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1179/2349] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:25:23.763772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.764201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.764480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.785339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:23.786669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:23.796713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1171/2350] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:23.810996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60be2-4e4e-41f7-8a7d-b3eb018af175 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:23.822947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60be2-4e4e-41f7-8a7d-b3eb018af175 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:23.827977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:23.828729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:23.829099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:23.829489 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:23.843288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:23.844798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:23.857794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1180/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:23.946744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:23.948676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:24.038647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaaacc-6ca2-402f-82cc-628a8b2aecbd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:24.045183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:24.045995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:24.046305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:24.050437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:24.052811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:24.068268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:24.070260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d56bc-c228-4ffb-82f2-7806580e5214 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:24.086061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1172/2352] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:26.315829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:26.318100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:26.334031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fccdc4-6b5f-45f8-9d8c-8cc07014da83 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:26.343675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:26.344716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:26.345258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:26.345732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:26.348872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:26.371785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:26.373887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:26.384701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1181/2353] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:25:30.231550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:30.232148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:30.232148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:30.272093 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:30.273699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:30.285076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1173/2354] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:30.298758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:30.311211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd74d2d-dbb8-4908-9ed0-c7f7e3748dee service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:30.318929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:30.319563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:30.319938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:30.320215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:30.330956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:30.332614 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:30.346567 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1182/2355] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:25:38.380903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:38.396965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56574920-33b6-4129-a6bd-b476168a2ac6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:38.403449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:38.404347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:38.404837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:38.405299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:38.407336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:38.476280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:38.478232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f90aa7-fc23-4249-b5bc-d02b314a3c7d service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:38.490154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1174/2356] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:25:40.339246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=72 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:44.167792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:44.177630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c21f6-1a8a-4240-a25d-ab0d8332afd9 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:44.181483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:44.182091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:44.182368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:44.182639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:44.184573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:44.196960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:44.198504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:44.208291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1183/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:25:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:25:48.484793 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:54.204339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:25:54.530908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:54.531448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:54.531565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:54.559915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:25:54.562614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:25:54.574264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1175/2358] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:25:54.612008 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:25:54.637725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a6650-254f-4c6e-be34-039061af3666 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:25:54.644399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:25:54.645051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:25:54.645325 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:25:54.645596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:25:54.656936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:25:54.660006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:25:54.671418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1184/2359] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:26:04.551644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:04.666346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:12.477588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:26:12.479020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:12.495314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f37d-d0d8-4c82-ac24-67e059d326b4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:26:12.501603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:26:12.502221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:12.502496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:12.502764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:12.504583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:12.569716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:26:12.571325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a895dc-d87b-42a5-8538-162f61c90c3f service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:26:12.584572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1176/2360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:26:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:26:16.474389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:26:16.494431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00eb2b-a912-4ccb-a6fc-de733aa90d4c service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:26:16.504695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:26:16.505730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:16.506215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:16.506693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:16.509802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:16.536742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:26:16.540138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:26:16.560960 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1185/2361] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:26:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:26:22.576900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=28 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:26.547330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:30.098010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:30.098564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:30.098564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:30.118590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] MFA Rules not processed for user `bf2cab4aebe54e44aff07c25182b8663`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:26:30.119833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:30.127989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1177/2362] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:26:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:26:40.113598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:44.267949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:26:44.280107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b754-d52c-47e7-ba73-1faf150e1b63 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:26:44.287264 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:26:44.288281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:44.288626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:44.288970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:44.291259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:44.305587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:26:44.307537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:26:44.336163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1186/2363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:26:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:26:49.968360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:26:49.981128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcdaf4-14db-4811-addf-cb6944a3b974 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:26:49.986798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:26:49.987396 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:49.987671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:49.987967 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:49.989768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:50.002918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:26:50.004526 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:26:50.015687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1178/2364] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:26:54.331205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=6 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:26:58.476380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:26:58.486745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2a9ad-fa87-4d52-ade8-b0aa4b74b34b service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:26:58.491609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:26:58.491609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:26:58.491609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:26:58.491609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:26:58.493284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:26:58.507019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:26:58.508496 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:26:58.518085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1187/2365] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:26:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:00.010620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:04.542413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:04.557062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77099923-b5e5-4574-be1c-094810e7dc8a service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:04.566107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:04.566756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:04.567079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:04.567472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:04.571128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:04.672280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:04.674378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:04.693391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1179/2366] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:05.344142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:05.353523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84a1b7-afb5-49e5-87ff-ba05e6d7c8f6 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:05.357810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:05.358469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:05.358783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:05.359125 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:05.362154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:05.438433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:05.439980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:05.450694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1188/2367] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:09.620542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:09.622348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:09.639271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9de2-60cf-466e-b835-391305c5323a service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:09.647375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:09.648463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:09.648743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:09.649019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:09.650885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:09.663975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:09.665931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:09.678165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1180/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:09.742199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:09.743863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:09.758673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787083f-5352-428d-967a-29643ae7fc9f service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:09.763629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:09.764301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:09.764557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:09.764825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] PATH_INFO: `/v3/users/037e346bc69b44919d018e4aee4ae57b` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:09.765969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037e346bc69b44919d018e4aee4ae57b)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:09.767940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:10.024392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037e346bc69b44919d018e4aee4ae57b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.174459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037e346bc69b44919d018e4aee4ae57b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.191638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037e346bc69b44919d018e4aee4ae57b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.192672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037e346bc69b44919d018e4aee4ae57b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.193412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-d8fdc809-420e-40d9-bf89-2a2019f2e796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037e346bc69b44919d018e4aee4ae57b'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.209141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1189/2369] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:09 2022] DELETE /identity/v3/users/037e346bc69b44919d018e4aee4ae57b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:10.630465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:10.648384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941fba2-711e-41ff-817d-3a7323bb1911 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:10.732414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:10.733087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:10.733361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:10.733627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] PATH_INFO: `/v3/projects/37d8a0e41eef4ae6b869541fa513e0c7` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:10.734966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d8a0e41eef4ae6b869541fa513e0c7)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:10.736996 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:10.859394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d8a0e41eef4ae6b869541fa513e0c7', 'request_id': 'req-b40541db-3a40-47f7-8df2-2e57ddde9294'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.866935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d8a0e41eef4ae6b869541fa513e0c7', 'request_id': 'req-b40541db-3a40-47f7-8df2-2e57ddde9294'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.951217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d8a0e41eef4ae6b869541fa513e0c7', 'request_id': 'req-b40541db-3a40-47f7-8df2-2e57ddde9294'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.966815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] The token cache is being invalidate because project 37d8a0e41eef4ae6b869541fa513e0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:10.970341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.970341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b40541db-3a40-47f7-8df2-2e57ddde9294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:10.970341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1181/2370] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:10 2022] DELETE /identity/v3/projects/37d8a0e41eef4ae6b869541fa513e0c7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:27:10.978025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:10.978609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:10.978755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.006676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:11.009358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:11.108302 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:11.128629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1190/2371] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:11.136607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.137005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.137512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.172637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:11.174475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:11.184368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1182/2372] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:11.191037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.219687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bb821-c1bf-4d07-9ff4-1216b15c298d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.219687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.219687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.219687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.220370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.220370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:11.220370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.220370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.234994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1191/2373] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:27:11.241459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.257788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906de19-8563-48cc-bd8d-bc38fdf09634 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.262890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.263513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.263816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.264104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.264752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.268171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.273173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:11.413974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1183/2374] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:11 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:11.418615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.429418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f08770-87b6-4c51-ab33-100e643e4b1a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.506800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.509714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.509714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.509714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.510018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.513016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.624202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1192/2375] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:11 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:11.628475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.640199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123906b-b540-4639-9a1c-49cd79fe3040 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.647280 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.648350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.648628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.648895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.649573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.651355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.664044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1184/2376] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:11.668937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.682071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab15dfb-0311-41a2-a0af-2d11d64bbed5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.688187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.688187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.688187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.688187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.691073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.691288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40debe-260d-437c-ad6b-dcab5dad5a20 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.702666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1193/2377] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:27:11.706945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:11.717885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596836-b51c-4775-8b53-46ac9b94fe1f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:11.724762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:11.725556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.726110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.726467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] PATH_INFO: `/v3/projects/8c8b8fc056ab43ad9a1f3e42dfa9fb60/users/0012983718104b8296194836398bff24/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.748765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8b8fc056ab43ad9a1f3e42dfa9fb60, user_id=0012983718104b8296194836398bff24, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:11.752818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:11.851307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1185/2378] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:11 2022] PUT /identity/v3/projects/8c8b8fc056ab43ad9a1f3e42dfa9fb60/users/0012983718104b8296194836398bff24/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:11.863274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1872d-1864-488c-a158-f6b3f209ab22 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:11.863793 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1872d-1864-488c-a158-f6b3f209ab22 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:11.864500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1872d-1864-488c-a158-f6b3f209ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:11.908293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-58e1872d-1864-488c-a158-f6b3f209ab22 None None] MFA Rules not processed for user `0012983718104b8296194836398bff24`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:11.910162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-58e1872d-1864-488c-a158-f6b3f209ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:12.007140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1194/2379] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:12.021995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:12.024402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:12.106883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a892b-457d-47cf-8566-79801f76d3e1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:12.111421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:12.112078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:12.112338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:12.112629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:12.122686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:12.124251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cee7c-06a2-4f89-80a1-007b9242ae95 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:12.135343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1186/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:27:22.003781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:22.131477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:23.051045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:23.051577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:23.051577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:23.071437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] MFA Rules not processed for user `a11d8472885c449db11686980171bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:23.073467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:23.155450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1195/2381] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:23.399724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4497-b512-4a2c-962f-aa691fc6522f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:23.400294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4497-b512-4a2c-962f-aa691fc6522f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:23.400608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4497-b512-4a2c-962f-aa691fc6522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:23.421807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-25ba4497-b512-4a2c-962f-aa691fc6522f None None] MFA Rules not processed for user `53d8816f0b3a4cb1a9da6dc11428b514`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:23.423125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25ba4497-b512-4a2c-962f-aa691fc6522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:23.494074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1187/2382] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:24.673502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:24.741737 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af184f-ddbe-400d-b0aa-65aa9d33fbfa None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:24.746476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:24.747314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:24.747314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:24.747314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] PATH_INFO: `/v3/users/0012983718104b8296194836398bff24` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:24.749216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0012983718104b8296194836398bff24)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:24.751148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:25.003572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0012983718104b8296194836398bff24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:25.072918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0012983718104b8296194836398bff24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:25.089096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0012983718104b8296194836398bff24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:25.089739 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0012983718104b8296194836398bff24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:25.090401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0012983718104b8296194836398bff24'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:25.103704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1196/2383] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:24 2022] DELETE /identity/v3/users/0012983718104b8296194836398bff24 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:25.108883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:25.109695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:25.109695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:25.131349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:25.132614 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:25.221748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1188/2384] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:25.234555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:25.236492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:25.274661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:25.305822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439efb5c-083c-404f-a801-3edf96ab548b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:25.324267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:25.329015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:25.329015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:25.329015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:25.337026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:25.338615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584334e5-de85-4249-b84a-2efc6c7bf27c service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:25.349654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1197/2385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:25.833958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:25.837755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:25.856163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290f5e-fb3d-4aa7-ad32-773e2de8a122 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:25.868286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:25.869217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:25.870574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:25.871041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] PATH_INFO: `/v3/projects/8c8b8fc056ab43ad9a1f3e42dfa9fb60` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:25.873404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8b8fc056ab43ad9a1f3e42dfa9fb60)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:25.876537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.062087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8b8fc056ab43ad9a1f3e42dfa9fb60', 'request_id': 'req-1e2c4993-75b8-426c-9e2f-d90024f053e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:26.069162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8b8fc056ab43ad9a1f3e42dfa9fb60', 'request_id': 'req-1e2c4993-75b8-426c-9e2f-d90024f053e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:26.196905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8b8fc056ab43ad9a1f3e42dfa9fb60', 'request_id': 'req-1e2c4993-75b8-426c-9e2f-d90024f053e2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:26.210761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] The token cache is being invalidate because project 8c8b8fc056ab43ad9a1f3e42dfa9fb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:26.211341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:26.212227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1e2c4993-75b8-426c-9e2f-d90024f053e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:26.214033 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1189/2386] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:25 2022] DELETE /identity/v3/projects/8c8b8fc056ab43ad9a1f3e42dfa9fb60 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:26.220798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.223638 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.224223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.268079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:26.271098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:26.364833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1198/2387] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:26.375240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.375661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.376003 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.398445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:26.404724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:26.409990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1190/2388] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:26.414271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.425100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427f4ab-c08d-43a1-b5d2-4c89bf2ac46c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.429781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.430392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.430668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.430940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.431618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:26.431953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.433570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.447108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1199/2389] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:27:26.451587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.462767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ea96-5858-4181-86bc-589372b7af0a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.468839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.469518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.470844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.470844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.470844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.473055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.551460 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:26.559587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1191/2390] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:26 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:26.564038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.574348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db93272-d796-451e-9daa-908ca8fc158f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.653602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.654348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.654652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.654920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.655881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.662441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.807563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1200/2391] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:26 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:26.809310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.821781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238220d-530a-445d-a719-b261fda17760 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.827062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.828679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.828679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.828846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.829490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.831100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.845673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1192/2392] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:27:26.846860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.857412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7a411-dd5a-44cb-89a1-f79309d93288 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.864202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.864811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.865119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.865394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.866156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.867773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fd733-c475-4d83-9ee9-0cba10a63036 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.887329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1201/2393] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:27:26.889099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:26.900408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1fbf2-5927-4c9e-8bbf-1c43b845cee9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:26.908665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:26.908665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:26.908665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:26.908665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] PATH_INFO: `/v3/projects/fa21d596d5824642a7673fea717512fd/users/5d99242fb03e4dcea474a70a7e668dca/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:26.923621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa21d596d5824642a7673fea717512fd, user_id=5d99242fb03e4dcea474a70a7e668dca, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:26.926499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:26.992325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1193/2394] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:26 2022] PUT /identity/v3/projects/fa21d596d5824642a7673fea717512fd/users/5d99242fb03e4dcea474a70a7e668dca/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:27.004338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:27.004622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:27.004920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:27.041413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] MFA Rules not processed for user `5d99242fb03e4dcea474a70a7e668dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:27.042741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:27.070133 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:27.127287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1202/2395] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:27.131644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:27.222556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98e02f-f143-4f2b-85d6-ef8b37c8d54c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:27.228527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:27.229149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:27.229428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:27.229699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:27.230351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:27.232487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:27.380718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1194/2396] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:27 2022] POST /identity/v3/projects => generated 405 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:27.385611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:27.407231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d16b1e-00d6-491d-a787-c6f79a899935 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:27.499672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:27.500236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:27.501336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:27.501336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:27.503132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:27.503812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:27.637055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1203/2397] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:27 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:27.643213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:27.657177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862f3f1-ae28-42c6-8412-14968da9bced admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:27.666630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:27.667325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:27.667605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:27.667935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:27.668594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:27.670580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:27.698557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1195/2398] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:27.702189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:27.714328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7270-14d8-440b-ad0a-7f1431577174 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:27.727798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:27.728048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:27.728280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:27.728570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] PATH_INFO: `/v3/projects/c190edd7e688410999f5e5e17d5ad775/users/20bd2c02973b45369be21a4648ca376f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:27.761707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c190edd7e688410999f5e5e17d5ad775, user_id=20bd2c02973b45369be21a4648ca376f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:27.761707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:27.915658 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1204/2399] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:27 2022] PUT /identity/v3/projects/c190edd7e688410999f5e5e17d5ad775/users/20bd2c02973b45369be21a4648ca376f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:27.915893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:27.927498 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966714-7354-4a22-90f7-fedc2c0989eb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:28.000818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:28.001721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:28.001998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:28.002275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:28.003160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:28.004853 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c38f58-180e-4532-a405-522288f53236 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:28.016717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1196/2400] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:28.021476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:28.033375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986965d6-e028-4dd3-a608-35accc5046fa admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:28.039319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:28.040138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:28.040355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:28.040716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] PATH_INFO: `/v3/projects/c190edd7e688410999f5e5e17d5ad775/users/20bd2c02973b45369be21a4648ca376f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:28.042820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c190edd7e688410999f5e5e17d5ad775, user_id=20bd2c02973b45369be21a4648ca376f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:28.045609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:28.065548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1205/2401] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:28 2022] PUT /identity/v3/projects/c190edd7e688410999f5e5e17d5ad775/users/20bd2c02973b45369be21a4648ca376f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:28.072195 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:28.072482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:28.072755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:28.120677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] MFA Rules not processed for user `20bd2c02973b45369be21a4648ca376f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:28.122199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:28.157357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:28.231065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1197/2402] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:28.252825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:28.257433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:28.331257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732bd0-f015-4d84-a78a-a67c5ab0d6bc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:28.335369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:28.337155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:28.337155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:28.337155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:28.348683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:28.350352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf37058-1049-4bd1-8f0d-1947c0c4c012 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:28.363066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1206/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:28.599363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:28.674105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a1bb-eb05-4608-a271-4023e0e73ec2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:28.682449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:28.683157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:28.683458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:28.683714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] PATH_INFO: `/v3/users/5d99242fb03e4dcea474a70a7e668dca` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:28.684946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d99242fb03e4dcea474a70a7e668dca)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:28.687743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:28.890089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d99242fb03e4dcea474a70a7e668dca'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:28.908011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d99242fb03e4dcea474a70a7e668dca'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:28.987282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d99242fb03e4dcea474a70a7e668dca'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:28.988072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d99242fb03e4dcea474a70a7e668dca'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:29.005160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d99242fb03e4dcea474a70a7e668dca'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:29.013139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1198/2404] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:28 2022] DELETE /identity/v3/users/5d99242fb03e4dcea474a70a7e668dca => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:29.017683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:29.027242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:29.027242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:29.037966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:29.039218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:29.055111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:29.119464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1207/2405] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:29.132559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:29.134013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:29.200105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:29.242471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedcc0b-3b99-462d-a6e6-fbb92aa7d629 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:29.259243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:29.260915 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:29.261349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:29.261804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:29.274927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:29.276414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:29.301415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1199/2406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:29.986227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:29.987584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:30.003374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b062362-0afe-41c7-b393-b78bed896751 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:30.010570 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:30.011223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:30.012171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:30.012171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] PATH_INFO: `/v3/projects/fa21d596d5824642a7673fea717512fd` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:30.013391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa21d596d5824642a7673fea717512fd)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:30.016283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:30.145721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa21d596d5824642a7673fea717512fd', 'request_id': 'req-1ca318e6-af9a-4ff3-875f-11e87215bb0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.157037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa21d596d5824642a7673fea717512fd', 'request_id': 'req-1ca318e6-af9a-4ff3-875f-11e87215bb0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.237118 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa21d596d5824642a7673fea717512fd', 'request_id': 'req-1ca318e6-af9a-4ff3-875f-11e87215bb0d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.257483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] The token cache is being invalidate because project fa21d596d5824642a7673fea717512fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:30.257777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.258707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.260558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1208/2407] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:29 2022] DELETE /identity/v3/projects/fa21d596d5824642a7673fea717512fd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:30.264343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:30.275824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28afc4-ba6c-443f-be59-eb54de456cd2 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:30.370255 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:30.371228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:30.371508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:30.371809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] PATH_INFO: `/v3/users/20bd2c02973b45369be21a4648ca376f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:30.375861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bd2c02973b45369be21a4648ca376f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:30.379313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:30.637304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bd2c02973b45369be21a4648ca376f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.645898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bd2c02973b45369be21a4648ca376f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.722108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bd2c02973b45369be21a4648ca376f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.722739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bd2c02973b45369be21a4648ca376f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.736953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8afcfa44-ee84-466d-91d7-3c3ec0d0b370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bd2c02973b45369be21a4648ca376f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:30.743090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1200/2408] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:30 2022] DELETE /identity/v3/users/20bd2c02973b45369be21a4648ca376f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:31.169883 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:31.173744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:31.193886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca318e6-af9a-4ff3-875f-11e87215bb0d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:31.273929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:31.274571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.274860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.275152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] PATH_INFO: `/v3/projects/c190edd7e688410999f5e5e17d5ad775` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.276321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c190edd7e688410999f5e5e17d5ad775)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:31.278417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:31.407596 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:31.411584 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c190edd7e688410999f5e5e17d5ad775', 'request_id': 'req-5c18af5d-1a7b-488d-9420-016307a6775c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:31.418265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c190edd7e688410999f5e5e17d5ad775', 'request_id': 'req-5c18af5d-1a7b-488d-9420-016307a6775c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:31.476728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c190edd7e688410999f5e5e17d5ad775', 'request_id': 'req-5c18af5d-1a7b-488d-9420-016307a6775c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:31.490282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] The token cache is being invalidate because project c190edd7e688410999f5e5e17d5ad775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:31.490572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:31.491234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5c18af5d-1a7b-488d-9420-016307a6775c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:31.492803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1209/2409] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:31 2022] DELETE /identity/v3/projects/c190edd7e688410999f5e5e17d5ad775 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:31.499598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623614-f721-43d5-8433-5838a8475946 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.518573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623614-f721-43d5-8433-5838a8475946 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.518573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2623614-f721-43d5-8433-5838a8475946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.521678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d2623614-f721-43d5-8433-5838a8475946 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:31.522953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d2623614-f721-43d5-8433-5838a8475946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:31.598719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1201/2410] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:31.607468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.607846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.608192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.633079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:31.634327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:31.643505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1210/2411] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:31.647833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623614-f721-43d5-8433-5838a8475946 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:31.652829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:31.659173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2623614-f721-43d5-8433-5838a8475946 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:31.666754 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:31.673508 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:31.683599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1202/2412] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:27:31.688242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:31.698366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944dfc-f9cd-458d-8845-d229820842ac None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:31.705881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:31.706545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.706817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.707084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.707702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:31.709678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:31.887825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1211/2413] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:31 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:27:31.894643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:31.900315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a85e-6a4b-4d73-9c27-37da67c23aa6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:31.962476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:31.963070 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:31.963343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:31.963611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:31.964274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:31.966185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.059728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1203/2414] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:31 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:32.064718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:32.075805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c132-52f3-4856-a301-e03f87720918 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:32.081382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:32.081997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.082281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.082542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.083179 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:32.084838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.095591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1212/2415] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:32.108199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:32.119179 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7462d6b-37db-4590-8d47-ae40a8ba9dd7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:32.124904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:32.125521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.125807 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.126074 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.126743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:32.128405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f0d7b-30ef-4583-8d74-411e4b6a9da8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.139072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1204/2416] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:32.143746 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:32.154876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4d21-851b-4550-91cd-2be44d720ac6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:32.159880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:32.160529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.160804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.161070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] PATH_INFO: `/v3/projects/2bac8513ba59489f94cd4342c478c426/users/f1e0f44cc89049748230cfd5959ede6e/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.176669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bac8513ba59489f94cd4342c478c426, user_id=f1e0f44cc89049748230cfd5959ede6e, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:32.185574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.255277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1213/2417] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:32 2022] PUT /identity/v3/projects/2bac8513ba59489f94cd4342c478c426/users/f1e0f44cc89049748230cfd5959ede6e/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:32.267737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.268083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.268359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.299531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] MFA Rules not processed for user `f1e0f44cc89049748230cfd5959ede6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:32.301278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:32.370527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1205/2418] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:32.383242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:32.385110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:32.455280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258729-c052-43ae-bd73-0c84c0ed179c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:32.461521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:32.463070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.463070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.463070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.480454 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:32.483940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096f4d-1ebe-47a0-b136-398b735cc0c2 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.500097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1214/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:27:32.535321 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:32.624236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:32.628538 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d6052-fbe9-468c-9e45-2a94fe0c89f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:32.633249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:32.637367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:32.637367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:32.637367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] PATH_INFO: `/v3/users/f1e0f44cc89049748230cfd5959ede6e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:32.637367 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e0f44cc89049748230cfd5959ede6e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:32.637706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:32.881936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e0f44cc89049748230cfd5959ede6e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:32.895521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e0f44cc89049748230cfd5959ede6e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.031470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e0f44cc89049748230cfd5959ede6e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.032177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e0f44cc89049748230cfd5959ede6e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.045474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e0f44cc89049748230cfd5959ede6e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.052372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1206/2420] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:32 2022] DELETE /identity/v3/users/f1e0f44cc89049748230cfd5959ede6e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:33.057156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:33.057474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:33.057805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:33.078433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:33.079817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:33.140558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1215/2421] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:33.150977 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:33.152407 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:33.210974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea456-d70a-4809-ae85-47a153f6a91a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:33.214675 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:33.215277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:33.215551 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:33.215869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:33.226073 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:33.227513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950317c-3901-4ec0-93f8-d10b583be106 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:33.241341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1207/2422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:33.712476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:33.716388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:33.734016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28a8ee-75f5-4bd9-9677-51e67bae15a0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:33.742067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:33.742723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:33.743049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:33.744850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] PATH_INFO: `/v3/projects/2bac8513ba59489f94cd4342c478c426` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:33.752032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bac8513ba59489f94cd4342c478c426)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:33.756079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:33.765113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:33.892165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bac8513ba59489f94cd4342c478c426', 'request_id': 'req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.898645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bac8513ba59489f94cd4342c478c426', 'request_id': 'req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.969185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bac8513ba59489f94cd4342c478c426', 'request_id': 'req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.986706 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] The token cache is being invalidate because project 2bac8513ba59489f94cd4342c478c426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:33.987087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.987852 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2c93cbc2-fdc8-4a0b-b569-15bdbe365222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:33.989790 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1216/2423] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:33 2022] DELETE /identity/v3/projects/2bac8513ba59489f94cd4342c478c426 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:33.999933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:33.999933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:33.999933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.023854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:34.025109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:34.111573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1208/2424] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:34.120498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.121380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.121380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.142032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:34.143301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:34.151970 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1217/2425] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:34.157050 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.168218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14448-9b53-46fe-8738-23170f4db71c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.174128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.174796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.175069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.175333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.176032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:34.176331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.177935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.190145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1209/2426] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:27:34.196096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.206094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a372-2594-42bb-bf52-5a45ad5435f4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.212346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.213225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.213505 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.213778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.214435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.216471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.295659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1218/2427] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:34 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:34.301004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.312659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0729d3-f49b-4f6b-afb7-afea1f4777d3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.316760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:34.390004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.390588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.390867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.391855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.392499 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.394432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.511608 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1210/2428] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:34 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:34.516667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.527152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc455-6481-45a4-aa00-48357e312195 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.533626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.534284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.534561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.534830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.535479 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.537176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.549395 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1219/2429] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:34.555387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.568639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0568029-e1a6-4352-af03-dd888e5bfbc7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.573549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.574190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.574490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.574758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.575395 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.577701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8d5b8-3445-4ca1-a148-c7b6cbc21e9f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.594159 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1211/2430] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:34.597911 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.608851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53bee-6506-4a77-aaaf-fb784bd3282b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.613743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.614393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.614666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.614931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] PATH_INFO: `/v3/projects/001d0420abb24fce850d3d692ce49e29/users/b50a4bbc87624b6183aacc82ec57cdc0/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.633138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] RBAC: Authorizing `identity:create_grant(project_id=001d0420abb24fce850d3d692ce49e29, user_id=b50a4bbc87624b6183aacc82ec57cdc0, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.636258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.725446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1220/2431] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:34 2022] PUT /identity/v3/projects/001d0420abb24fce850d3d692ce49e29/users/b50a4bbc87624b6183aacc82ec57cdc0/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:34.735918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.736193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.736500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.783497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] MFA Rules not processed for user `b50a4bbc87624b6183aacc82ec57cdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:34.784708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:34.869997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1212/2432] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:34.884716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:34.886730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:34.961253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b9c7-95e2-476d-9772-f34dc4a6284d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:34.967506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:34.969637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:34.970136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:34.970667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:34.983559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:34.985188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6b4d4-852a-45a9-bf3b-a099dc0f18b4 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:34.996935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1221/2433] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:43.938099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:44.010876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7469b-7bfc-4872-baed-b389ce9c8a64 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:44.016010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:44.016645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:44.016919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:44.017196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] PATH_INFO: `/v3/users/b50a4bbc87624b6183aacc82ec57cdc0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:44.018365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50a4bbc87624b6183aacc82ec57cdc0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:44.020339 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:44.042672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:44.280926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50a4bbc87624b6183aacc82ec57cdc0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:44.289034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50a4bbc87624b6183aacc82ec57cdc0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:44.391256 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50a4bbc87624b6183aacc82ec57cdc0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:44.392029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50a4bbc87624b6183aacc82ec57cdc0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:44.407244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50a4bbc87624b6183aacc82ec57cdc0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:44.414340 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1213/2434] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:43 2022] DELETE /identity/v3/users/b50a4bbc87624b6183aacc82ec57cdc0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:44.420024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:44.421878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:44.421878 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:44.446494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:44.447736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:44.479708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:44.519629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1222/2435] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:44.530261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:44.531677 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:44.598588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10231c-3685-45e9-8e15-caf23d6eb2e5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:44.603336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:44.603994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:44.604292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:44.604542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:44.614530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:44.616001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57bcdc-68e3-4af8-9cfa-cb46d152ddcb service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:44.627154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1214/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:27:45.186617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:45.188108 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:45.202622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcc350-c334-42af-aadb-cfaef5c3e27e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:45.218178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:45.218885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.219160 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.219434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] PATH_INFO: `/v3/projects/001d0420abb24fce850d3d692ce49e29` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.223498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001d0420abb24fce850d3d692ce49e29)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:45.225554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:45.376895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001d0420abb24fce850d3d692ce49e29', 'request_id': 'req-38fbb077-c26b-43f1-acf0-075c787fdb12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:45.385963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001d0420abb24fce850d3d692ce49e29', 'request_id': 'req-38fbb077-c26b-43f1-acf0-075c787fdb12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:45.459272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001d0420abb24fce850d3d692ce49e29', 'request_id': 'req-38fbb077-c26b-43f1-acf0-075c787fdb12'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:45.475662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] The token cache is being invalidate because project 001d0420abb24fce850d3d692ce49e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:45.475985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:45.476652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-38fbb077-c26b-43f1-acf0-075c787fdb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:45.478150 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1223/2437] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:45 2022] DELETE /identity/v3/projects/001d0420abb24fce850d3d692ce49e29 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:45.484170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.484944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.485108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.509353 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:45.510587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:45.600350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1215/2438] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:45.602366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.602685 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.603286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.625259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:45.626482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:45.634673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1224/2439] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:45.639653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:45.650695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c86695-bbe7-4048-aa70-7198e9d15019 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:45.655969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:45.656589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.657013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.657338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.657999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:45.658297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:45.659968 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:45.676200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1216/2440] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:27:45.690224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:45.700290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9dbb5-9332-4ad3-8a4f-3cfbb2d5a144 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:45.705337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:45.705942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.706213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.706477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.707090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:45.709061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:45.873081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1225/2441] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:45 2022] POST /identity/v3/projects => generated 397 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:45.877611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:45.889013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba8a35-7f4b-46a6-aa82-a7618d61b41e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:45.922795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:45.963181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:45.963934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:45.964903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:45.965301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:45.965933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:45.968751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:46.078042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1217/2442] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:45 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:27:46.084677 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:46.096405 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15c4a-83a8-45b2-8dcf-759b0cf9b0bc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:46.101340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:46.101950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:46.102352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:46.102899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:46.103369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:46.104930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:46.116410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1226/2443] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:27:46.120245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:46.133021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938cfb2-54b9-4615-9393-c4b391ef35fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:46.138235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:46.139473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:46.140429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:46.140721 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:46.141725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:46.143501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cb10d-899b-4070-be5c-31719eb065f7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:46.155696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1218/2444] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:46.160018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:46.171698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74cdff-b670-4b40-be61-a5bad32ac15c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:46.182171 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:46.182850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:46.183199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:46.183394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] PATH_INFO: `/v3/projects/b9631378cb144a7599af5983067729e5/users/12a3274b5d184f5c966d47cfda84f22c/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:46.199695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9631378cb144a7599af5983067729e5, user_id=12a3274b5d184f5c966d47cfda84f22c, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:46.203398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:46.307451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1227/2445] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:46 2022] PUT /identity/v3/projects/b9631378cb144a7599af5983067729e5/users/12a3274b5d184f5c966d47cfda84f22c/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:46.308871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:46.309464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:46.309464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:46.362622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] MFA Rules not processed for user `12a3274b5d184f5c966d47cfda84f22c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:46.365113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:46.471847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1219/2446] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:46.486907 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:46.488926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:46.573722 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc60d-c870-4ca9-ad29-f8ce9581fc53 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:46.579182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:46.579950 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:46.580225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:46.580443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:46.587727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:46.590513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:46.592049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135b637-ae67-44c3-ab3d-74c6de3a9cd3 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:46.603197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1228/2447] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:53.855603 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:53.923731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481996c0-b6eb-48ae-b927-2a1d3d5a196b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:53.928558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:53.929196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:53.929468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:53.929734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] PATH_INFO: `/v3/users/12a3274b5d184f5c966d47cfda84f22c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:53.930898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a3274b5d184f5c966d47cfda84f22c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:53.932862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:54.196372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:54.207220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a3274b5d184f5c966d47cfda84f22c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:54.217989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a3274b5d184f5c966d47cfda84f22c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:54.350827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a3274b5d184f5c966d47cfda84f22c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:54.351674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a3274b5d184f5c966d47cfda84f22c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:54.365965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a3274b5d184f5c966d47cfda84f22c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:54.373434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1220/2448] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:27:53 2022] DELETE /identity/v3/users/12a3274b5d184f5c966d47cfda84f22c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:54.378860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:54.379550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:54.379550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:54.402848 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:54.404844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:54.483477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1229/2449] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:54.493994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:54.495427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:54.561653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb986-654e-4b8d-927f-5bfff9f7d7b9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:54.565848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:54.571005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:54.571005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:54.571005 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:54.578168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:54.579668 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba3f0c-d791-46d4-87fc-358bf61b6175 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:54.591377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1221/2450] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:27:55.114225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.115895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:55.137732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b05d-f2bc-4411-b7d2-37eefeb9718e None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.144955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.145644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.145916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.146249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] PATH_INFO: `/v3/projects/b9631378cb144a7599af5983067729e5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.148206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9631378cb144a7599af5983067729e5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.152854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.274232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9631378cb144a7599af5983067729e5', 'request_id': 'req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:55.281841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9631378cb144a7599af5983067729e5', 'request_id': 'req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:55.350652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9631378cb144a7599af5983067729e5', 'request_id': 'req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:55.366822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] The token cache is being invalidate because project b9631378cb144a7599af5983067729e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:27:55.366822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:55.366822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-0095a2f3-1a43-4025-9a62-1ed1cc3f1469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:27:55.367345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1230/2451] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:27:55 2022] DELETE /identity/v3/projects/b9631378cb144a7599af5983067729e5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:55.374044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.374653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.374653 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.402912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:55.405028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:55.491458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1222/2452] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:55.500113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.500733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.500733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.521889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:55.523106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:55.532389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1231/2453] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:27:55.537021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.549233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3f385-500c-44ff-87af-6c54bfd6765d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.554022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.554694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.554995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.555261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.555943 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:27:55.556244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.557876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.572835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1223/2454] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:27:55.577559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.587029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88564e-5028-47e8-86f0-d1c24c6e4a5c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.592715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.593606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.593934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.594205 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.595257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.598111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.697708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1232/2455] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:27:55 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:55.701985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.713154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c748fd-0c3e-45ab-a806-3d4c06b286c3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.758231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:55.777267 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.778061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.778061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.780309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.780309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.780979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.887702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1224/2456] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:27:55 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:27:55.892189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.903272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aefe6-7eb1-4346-9e5a-a5508b4f84be admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.909072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.914587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.914587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.914587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.914587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.914587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.928061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1233/2457] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:55.931905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.943338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e055b-abf9-4d2b-ad7c-cd10e312737b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.948086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.948633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.948906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.949176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:55.949814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:55.951484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef352c38-3978-473f-8da7-48fc2e036eab admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:55.963173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1225/2458] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:27:55.968327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:55.980256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038002-d46a-437c-a591-bf4b70b2eae3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:55.986211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:55.986900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:55.987172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:55.987441 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] PATH_INFO: `/v3/projects/ddf2c4ae08864a11ab203550fcadf522/users/b90c73991c004f4c89a61932982307b8/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:56.007207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf2c4ae08864a11ab203550fcadf522, user_id=b90c73991c004f4c89a61932982307b8, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:56.010050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:56.129642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1234/2459] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:27:55 2022] PUT /identity/v3/projects/ddf2c4ae08864a11ab203550fcadf522/users/b90c73991c004f4c89a61932982307b8/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:27:56.135105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c009-f875-4311-a0bd-b8ea75e82dcb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:56.135386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c009-f875-4311-a0bd-b8ea75e82dcb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:56.135658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c009-f875-4311-a0bd-b8ea75e82dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:56.155355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d155c009-f875-4311-a0bd-b8ea75e82dcb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:27:56.156797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d155c009-f875-4311-a0bd-b8ea75e82dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:56.225252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1226/2460] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:27:56.247764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:27:56.250227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:27:56.275129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:27:56.323633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3e0a-60f2-4c93-959e-913661c03e3d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:27:56.328270 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:27:56.328880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:27:56.329158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:27:56.329430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:27:56.339696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:27:56.341166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:27:56.350923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1235/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:28:02.506593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:02.507363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:02.507363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:02.571944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] MFA Rules not processed for user `b90c73991c004f4c89a61932982307b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:28:02.576730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:02.699652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1227/2462] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:28:02.705457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:02.772226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72812-1b99-4cb2-9660-56836bf1bb3a service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:02.779635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:02.780378 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:02.780650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:02.780918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:02.781591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:02.783705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:02.924892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1236/2463] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:28:02 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:28:02.926903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:02.951658 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54df26-f68e-4e9a-a7ad-18809aac4540 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:02.986176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:03.029901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:03.030517 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:03.030790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:03.031083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:03.031702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:03.033663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:03.150465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1228/2464] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:28:02 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:28:03.154812 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:03.166684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0a64b-68fe-4f63-ab8c-95af22326a8b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:03.171471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:03.172129 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:03.172556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:03.172827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:03.173484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:03.175155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:03.187048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1237/2465] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:28:03.192486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:03.203629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca8fba-7927-426a-93fa-8015b53faa0f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:03.208524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:03.209184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:03.209459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:03.209730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] PATH_INFO: `/v3/projects/caa54e44c24246b184cfe3dadc8725ba/users/11ce46c5de0d4e508c45a6dcf9f993b6/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:03.226794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa54e44c24246b184cfe3dadc8725ba, user_id=11ce46c5de0d4e508c45a6dcf9f993b6, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:03.232542 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:03.339866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1229/2466] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:28:03 2022] PUT /identity/v3/projects/caa54e44c24246b184cfe3dadc8725ba/users/11ce46c5de0d4e508c45a6dcf9f993b6/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:28:03.346451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:03.362557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e16d7-312e-488c-9987-44d546d8d83d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:03.431866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:03.432853 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:03.433029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:03.433313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:03.433968 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:03.436657 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16964cd-aeb5-4d8c-940a-f1681f003359 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:03.448139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1238/2467] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:28:03.453061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:03.464250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e75d3-ed34-40c8-8848-2c4e34bf616f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:03.469326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:03.469991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:03.470268 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:03.470541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] PATH_INFO: `/v3/projects/caa54e44c24246b184cfe3dadc8725ba/users/11ce46c5de0d4e508c45a6dcf9f993b6/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:03.472565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa54e44c24246b184cfe3dadc8725ba, user_id=11ce46c5de0d4e508c45a6dcf9f993b6, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:03.475327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:03.488828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1230/2468] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:28:03 2022] PUT /identity/v3/projects/caa54e44c24246b184cfe3dadc8725ba/users/11ce46c5de0d4e508c45a6dcf9f993b6/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:28:09.870275 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28353f-2529-49ba-ac73-5a6dd2d7f18e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:09.870871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28353f-2529-49ba-ac73-5a6dd2d7f18e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:09.870871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28353f-2529-49ba-ac73-5a6dd2d7f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:09.917347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-4d28353f-2529-49ba-ac73-5a6dd2d7f18e None None] MFA Rules not processed for user `11ce46c5de0d4e508c45a6dcf9f993b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:28:09.919660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4d28353f-2529-49ba-ac73-5a6dd2d7f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:09.952515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:10.009486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1239/2469] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:28:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:28:10.020397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:10.020832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:10.141474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c98e-98da-46c9-b12f-81ec2a32403a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:10.145298 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:10.145913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:10.146218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:10.146489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:10.210951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:10.212461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:10.224893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1231/2470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:28:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:28:10.619966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8f720-7124-4970-9527-25677d467206 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:10.620252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8f720-7124-4970-9527-25677d467206 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:10.620530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8f720-7124-4970-9527-25677d467206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:10.653498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ada8f720-7124-4970-9527-25677d467206 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:28:10.654742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ada8f720-7124-4970-9527-25677d467206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:10.723159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1240/2471] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:28:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:28:10.932337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:10.933768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:10.956744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:11.011393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c058b4f-abb7-4e41-b64a-c7d1e1bb0443 service glance] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:11.016743 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:11.017405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:11.017681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:11.017957 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:11.027038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:11.029024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d280f-1b9b-4d51-87be-1ea4841ddea7 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:11.037775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1232/2472] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:28:20.715750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=52 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:21.034571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=25 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:22.000463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:22.001079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:22.001079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:22.019882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] MFA Rules not processed for user `b90c73991c004f4c89a61932982307b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:28:22.021089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:22.029172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1241/2473] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:28:26.453199 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:26.453647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:26.453647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:26.473946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:28:26.475211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:26.483384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1233/2474] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:28:26.498462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:26.511062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc8b0-848c-4558-8bfa-845520e7ad66 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:26.517620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:26.518235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:26.518510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:26.527215 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:26.528674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:26.530319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561917-13ac-4d80-b5fb-f12b8e13b51b service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:26.542239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1242/2475] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:28:36.468041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:36.538662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=9 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:28:55.794240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:28:55.795970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:55.917161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfcb25-5cdd-4bb7-a21e-949ea0c0add1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:28:55.923935 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:28:55.924762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:28:55.925038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:28:55.925455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:28:55.927437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:28:55.941421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:28:55.943253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:28:55.957910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1234/2476] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:29:01.556507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:01.557132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:01.557132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:01.575804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] MFA Rules not processed for user `bf2cab4aebe54e44aff07c25182b8663`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:29:01.577032 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:01.633403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1243/2477] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:29:02.430496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:02.432241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:02.529247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b240-60f3-45e3-82fb-3887d2db3238 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:02.533797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:02.534399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:02.534673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:02.534944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:02.545579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:02.547654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:02.557606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1235/2478] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:29:11.626225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=25 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:12.553274 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=76 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:17.369936 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:17.381185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468898-940d-4b86-a24c-01b1dcce4ace None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:17.386227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:17.386839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:17.387147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:17.387370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:17.389256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:17.464350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:17.465826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:17.478469 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1244/2479] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:29:25.696835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:25.711645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee6474-1dda-47ef-a6e1-98c6db579d1d service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:25.718969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:25.720328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:25.720605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:25.720879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:25.723404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:25.819822 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:25.821145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:25.831063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1236/2480] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:29:27.472930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=28 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:34.092957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:34.097003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:34.115233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fab39-4904-4ea8-a187-965d6f2e40d8 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:34.122276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3319-f412-4acf-b98e-199344840447 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:34.123278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3319-f412-4acf-b98e-199344840447 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:34.123740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3319-f412-4acf-b98e-199344840447 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:34.124226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3319-f412-4acf-b98e-199344840447 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:34.126792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-324f3319-f412-4acf-b98e-199344840447 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:34.147823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3319-f412-4acf-b98e-199344840447 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:34.147823 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3319-f412-4acf-b98e-199344840447 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:34.167521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1245/2481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:29:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:29:34.287784 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:34.289926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:34.309261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd60d7-7935-4848-8d4b-51e6aa77ac08 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:34.316191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:34.316805 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:34.317106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:34.317362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] PATH_INFO: `/v3/users/f37cab4f820446e0bcdb720c5867f6ff` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:34.318540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37cab4f820446e0bcdb720c5867f6ff)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:34.320577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:34.623450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37cab4f820446e0bcdb720c5867f6ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:34.634768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37cab4f820446e0bcdb720c5867f6ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:34.743189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37cab4f820446e0bcdb720c5867f6ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:34.743866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37cab4f820446e0bcdb720c5867f6ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:34.757899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37cab4f820446e0bcdb720c5867f6ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:34.764117 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1237/2482] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:29:34 2022] DELETE /identity/v3/users/f37cab4f820446e0bcdb720c5867f6ff => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:29:35.019863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3319-f412-4acf-b98e-199344840447 service placement] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:35.033520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3319-f412-4acf-b98e-199344840447 service placement] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:35.113212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:35.113884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:35.114099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:35.114367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] PATH_INFO: `/v3/projects/4767f748b55f40958e6976d42c58b4fd` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:35.115513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4767f748b55f40958e6976d42c58b4fd)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:35.117476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:35.227712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4767f748b55f40958e6976d42c58b4fd', 'request_id': 'req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.236719 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4767f748b55f40958e6976d42c58b4fd', 'request_id': 'req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.314957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4767f748b55f40958e6976d42c58b4fd', 'request_id': 'req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.330985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] The token cache is being invalidate because project 4767f748b55f40958e6976d42c58b4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:29:35.332864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.332864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.333490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1246/2483] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:29:35 2022] DELETE /identity/v3/projects/4767f748b55f40958e6976d42c58b4fd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:29:35.337672 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:35.339088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:35.356775 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e94b66-93a4-451c-b646-54e6518c0669 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:35.436470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:35.437282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:35.438098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:35.438650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] PATH_INFO: `/v3/users/1c1013a1f39144668ff58b16e55bf0e3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:35.440596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1013a1f39144668ff58b16e55bf0e3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:35.442549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:35.448523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:35.681463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1013a1f39144668ff58b16e55bf0e3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.691726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1013a1f39144668ff58b16e55bf0e3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.800068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1013a1f39144668ff58b16e55bf0e3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.800863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1013a1f39144668ff58b16e55bf0e3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.817009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bc5aabd6-240d-4d3b-a1a3-b091c6557713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1013a1f39144668ff58b16e55bf0e3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:35.823513 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1238/2484] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:29:35 2022] DELETE /identity/v3/users/1c1013a1f39144668ff58b16e55bf0e3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:29:36.118245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:36.120565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:36.139071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de7cb8-01ec-4cf0-9fd1-1cf75ef87cc2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:36.207642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:36.208300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:36.208571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:36.208834 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] PATH_INFO: `/v3/projects/17c2598f5b75495c9d6665854fbbf5b3` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:36.210104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c2598f5b75495c9d6665854fbbf5b3)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:36.212047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:36.237112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:36.366491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c2598f5b75495c9d6665854fbbf5b3', 'request_id': 'req-b7293747-6118-44d9-a725-d3cdab540157'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:36.374080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c2598f5b75495c9d6665854fbbf5b3', 'request_id': 'req-b7293747-6118-44d9-a725-d3cdab540157'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:36.428073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c2598f5b75495c9d6665854fbbf5b3', 'request_id': 'req-b7293747-6118-44d9-a725-d3cdab540157'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:36.440771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] The token cache is being invalidate because project 17c2598f5b75495c9d6665854fbbf5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:29:36.441045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:36.441792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:29:36.443554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1247/2485] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:29:36 2022] DELETE /identity/v3/projects/17c2598f5b75495c9d6665854fbbf5b3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:29:45.909240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:46.520520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:29:55.604105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:55.604618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:55.604618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:55.629557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:29:55.631021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:55.711898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1239/2486] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:29:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:29:55.763272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:29:55.764864 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:29:55.861721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7293747-6118-44d9-a725-d3cdab540157 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:29:55.868394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:29:55.869019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:29:55.869298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:29:55.869576 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:29:55.882065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:29:55.884247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:29:55.894167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1248/2487] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:30:05.080452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:05.083855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:05.165706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700000-3fc0-4536-9a24-0f6bb1f1cde2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:05.169348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:05.169953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:05.170224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:05.170492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:05.172416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:05.273417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:05.275778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:05.289079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1240/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:05.890661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=32 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:10.125681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:10.128193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:10.164120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64131cf1-ffcd-4ebe-87d4-bf9322cac077 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:10.172181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:10.172971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:10.173317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:10.173982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] PATH_INFO: `/v3/users/a11d8472885c449db11686980171bd22` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:10.192984 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11d8472885c449db11686980171bd22)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:10.195234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:10.562786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11d8472885c449db11686980171bd22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:10.673899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11d8472885c449db11686980171bd22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:10.695558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11d8472885c449db11686980171bd22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:10.696733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11d8472885c449db11686980171bd22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:10.697714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-add9e60e-6881-4087-8178-88d4fce97822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11d8472885c449db11686980171bd22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:10.720839 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1249/2489] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:10 2022] DELETE /identity/v3/users/a11d8472885c449db11686980171bd22 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:11.053871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:11.070919 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d8db1-0c04-4c4f-8fd0-b9a1a0ad8078 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:11.149883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:11.158764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:11.165075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:11.165075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:11.165075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] PATH_INFO: `/v3/projects/60226f5d5db8459ab7380fff204e9f0b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:11.176728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60226f5d5db8459ab7380fff204e9f0b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:11.178704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:11.374851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60226f5d5db8459ab7380fff204e9f0b', 'request_id': 'req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:11.383100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60226f5d5db8459ab7380fff204e9f0b', 'request_id': 'req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:11.547975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60226f5d5db8459ab7380fff204e9f0b', 'request_id': 'req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:11.562100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] The token cache is being invalidate because project 60226f5d5db8459ab7380fff204e9f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:11.563724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:11.563724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-98488aa9-ca5d-4ff4-bdfe-e6bab7abaf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:11.566183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1241/2490] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:11 2022] DELETE /identity/v3/projects/60226f5d5db8459ab7380fff204e9f0b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:11.571265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:11.571870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:11.571870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:11.639872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:11.641067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:11.712450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1250/2491] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:11.721725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:11.722062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:11.722350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:11.744437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:11.745670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:11.754928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1242/2492] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:11.759544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:11.771331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a25f05-85b2-4257-b8ca-ac7a0c22b3dc None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:11.776107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:11.776720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:11.776995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:11.777265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:11.777909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:30:11.778206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:11.779895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:11.794723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1251/2493] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:30:11.799116 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:11.809399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28ece-8d72-49bc-b11d-5193fec4ff1c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:11.814363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:11.815113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:11.815451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:11.816988 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:11.817699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:11.819719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:11.945305 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1243/2494] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:11 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:11.949082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:11.960103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8301c-40e0-4626-8614-7f2bd43c4515 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:11.977284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:12.031517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.032152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.032431 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.032695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.033329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.035463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.142781 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1252/2495] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:11 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:12.144569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.157031 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eb85a-a8ea-4d48-a3f4-3ea894ed2313 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.162826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.163821 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.164214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.164596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.165487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.167102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.178546 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1244/2496] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:12.184382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.202114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62605-ffca-4cbe-962e-506d1eb3cd67 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.211849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.212688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.213170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.213622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.214707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.217619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cc703-4f6f-4d60-8375-8b063a5d8a11 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.233642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1253/2497] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:12.239953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.250720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6be9-2302-4943-bee6-d849fc40a508 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.259094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.259908 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.260292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.260664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] PATH_INFO: `/v3/projects/0f57568299f348e29627e396d3f2d481/users/0b11d90109f64ba388d8e75b3de3bc28/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.277980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f57568299f348e29627e396d3f2d481, user_id=0b11d90109f64ba388d8e75b3de3bc28, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.281072 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.369628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1245/2498] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:12 2022] PUT /identity/v3/projects/0f57568299f348e29627e396d3f2d481/users/0b11d90109f64ba388d8e75b3de3bc28/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:12.381882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.382144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.382414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.421765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] MFA Rules not processed for user `0b11d90109f64ba388d8e75b3de3bc28`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:12.424549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:12.497520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1254/2499] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:12.507748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.568092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.570180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:12.601028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaec4-1846-471a-a85c-9d64db4a2dd4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.606780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.607404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.607670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.607976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.608611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.610716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.628124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:12.646620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf22c1-05dd-4225-869a-440af6e31ef0 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.651185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.662141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.662141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.662141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.662141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:12.700800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:12.713850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1246/2500] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:12 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:30:12.717696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.755531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.757835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.789575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1255/2501] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:12.797863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212eec8-49e0-45cb-ba0a-b2a3a8e2b476 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.804108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.805801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.805801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.805801 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.806069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.807951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.895938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1247/2502] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:12 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:30:12.898265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.910835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30547131-56b3-444c-b962-247ebe63f2d5 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.919148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.919783 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.920070 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.920334 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.920967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.922585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:12.935597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1256/2503] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:12.942004 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:12.954781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8a9a-5011-4b77-bdfc-ddcef6398e1b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:12.961484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:12.962958 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:12.963236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:12.963591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] PATH_INFO: `/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc/users/c635b407a4e147d7995fd0e1cbbe2887/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:12.982292 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9751714efcc4b49b627bc00fe9a1ccc, user_id=c635b407a4e147d7995fd0e1cbbe2887, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:12.985061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:13.083867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1248/2504] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:12 2022] PUT /identity/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc/users/c635b407a4e147d7995fd0e1cbbe2887/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:13.088044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:13.099692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd8e6f-b38d-4821-81b3-506ffa1486a2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:13.165298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:13.165904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:13.166187 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:13.166494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:13.167162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:13.168870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd8351-d3a4-4f66-830c-8dd913b29295 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:13.182789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1257/2505] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:30:13.186694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:13.198380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01466b-a228-4364-95b9-b590d78f54da admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:13.203433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:13.204132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:13.204410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:13.204676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] PATH_INFO: `/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc/users/c635b407a4e147d7995fd0e1cbbe2887/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:13.208030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9751714efcc4b49b627bc00fe9a1ccc, user_id=c635b407a4e147d7995fd0e1cbbe2887, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:13.210205 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:13.221135 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1249/2506] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:13 2022] PUT /identity/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc/users/c635b407a4e147d7995fd0e1cbbe2887/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:13.232103 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:13.232384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:13.232651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:13.264093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] MFA Rules not processed for user `c635b407a4e147d7995fd0e1cbbe2887`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:13.264460 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:13.372280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1258/2507] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:13.380846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:13.382572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:13.483601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459e73c-90fc-4d2e-8f46-798c5d0e70a1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:13.489809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:13.490420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:13.490698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:13.490965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:13.501448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:13.503225 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:13.515047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1250/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:14.190019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:14.204379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142168-f215-4690-892d-ffba57fd5b61 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:14.209228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:14.209830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:14.210117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:14.210389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:14.213606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:14.233267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:14.304122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:14.305571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f5f93-f179-41d1-a385-65b0d2f96af7 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:14.317948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1259/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:14.582764 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:14.610599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:14.648134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8388-6abe-48f0-8506-78b190f35e6c service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:14.652907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:14.653534 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:14.653808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:14.654082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] PATH_INFO: `/v3/users/0b11d90109f64ba388d8e75b3de3bc28` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:14.655300 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b11d90109f64ba388d8e75b3de3bc28)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:14.657258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:14.962125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b11d90109f64ba388d8e75b3de3bc28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:14.970110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b11d90109f64ba388d8e75b3de3bc28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:15.119377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b11d90109f64ba388d8e75b3de3bc28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:15.120320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b11d90109f64ba388d8e75b3de3bc28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:15.134696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b11d90109f64ba388d8e75b3de3bc28'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:15.141500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1251/2510] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:14 2022] DELETE /identity/v3/users/0b11d90109f64ba388d8e75b3de3bc28 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:15.146197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:15.146580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:15.146759 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:15.168618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:15.175879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:15.240210 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1260/2511] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:15.250119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:15.251557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:15.316052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a9932-c748-48fe-a1ee-911877fbfd94 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:15.320104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:15.320972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:15.320972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:15.321218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:15.331868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:15.333462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:15.344674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1252/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:15.871229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:15.872818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:15.896434 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2329-fe4f-46b0-9c0e-c1720d1fcc36 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:15.901941 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:15.902482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:15.902755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:15.903065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] PATH_INFO: `/v3/projects/0f57568299f348e29627e396d3f2d481` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:15.904348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f57568299f348e29627e396d3f2d481)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:15.906119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:16.030208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f57568299f348e29627e396d3f2d481', 'request_id': 'req-f95aee40-4f01-466c-a0d1-437f99883fbe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.037320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f57568299f348e29627e396d3f2d481', 'request_id': 'req-f95aee40-4f01-466c-a0d1-437f99883fbe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.136276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f57568299f348e29627e396d3f2d481', 'request_id': 'req-f95aee40-4f01-466c-a0d1-437f99883fbe'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.148563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] The token cache is being invalidate because project 0f57568299f348e29627e396d3f2d481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:16.148854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.149500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.151012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1261/2513] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:15 2022] DELETE /identity/v3/projects/0f57568299f348e29627e396d3f2d481 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:16.154980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:16.169190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035c7d-354e-4868-808d-239d51718121 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:16.214739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:16.227909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:16.228530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:16.233122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:16.233122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] PATH_INFO: `/v3/users/c635b407a4e147d7995fd0e1cbbe2887` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:16.233122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c635b407a4e147d7995fd0e1cbbe2887)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:16.233122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:16.447662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c635b407a4e147d7995fd0e1cbbe2887'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.454541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c635b407a4e147d7995fd0e1cbbe2887'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.570768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c635b407a4e147d7995fd0e1cbbe2887'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.571391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c635b407a4e147d7995fd0e1cbbe2887'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.584351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4721ee59-4a24-4c7f-adaf-7f188f7320e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c635b407a4e147d7995fd0e1cbbe2887'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:16.591351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1253/2514] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:16 2022] DELETE /identity/v3/users/c635b407a4e147d7995fd0e1cbbe2887 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:17.109369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:17.110837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.125633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aee40-4f01-466c-a0d1-437f99883fbe admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:17.152633 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:17.208361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:17.209276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.209548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.209813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] PATH_INFO: `/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.210965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9751714efcc4b49b627bc00fe9a1ccc)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:17.212938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:17.304266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3574-2938-4b4c-957f-b416c0997199 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.304854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3574-2938-4b4c-957f-b416c0997199 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.304854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3574-2938-4b4c-957f-b416c0997199 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.306262 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1254/2515] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 18:30:17.312932 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015281f5-cdad-472b-a21c-d2698be8711a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.313817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015281f5-cdad-472b-a21c-d2698be8711a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.314095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015281f5-cdad-472b-a21c-d2698be8711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.349928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9751714efcc4b49b627bc00fe9a1ccc', 'request_id': 'req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:17.357162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9751714efcc4b49b627bc00fe9a1ccc', 'request_id': 'req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:17.374192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-015281f5-cdad-472b-a21c-d2698be8711a None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:17.377359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-015281f5-cdad-472b-a21c-d2698be8711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.439734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9751714efcc4b49b627bc00fe9a1ccc', 'request_id': 'req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:17.450154 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1255/2516] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:30:17.451470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] The token cache is being invalidate because project c9751714efcc4b49b627bc00fe9a1ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:17.451854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:17.452497 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:17.454067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1262/2517] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:17 2022] DELETE /identity/v3/projects/c9751714efcc4b49b627bc00fe9a1ccc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:17.461404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587a59-5b86-48bb-a894-7a73c24cbf8b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.461794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587a59-5b86-48bb-a894-7a73c24cbf8b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.462107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587a59-5b86-48bb-a894-7a73c24cbf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.463035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:17.464632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.483217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8a587a59-5b86-48bb-a894-7a73c24cbf8b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:17.484680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a587a59-5b86-48bb-a894-7a73c24cbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.526218 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a6b4-f6ab-409f-be0b-f97be0d1b6a7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:17.532707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f48db1a2504c9f80ceead1166e374a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:17.533308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.533581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.533847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.535523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:17.535974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.551603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:17.556555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:17.556964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1256/2518] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:17.565937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.566214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.566488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.569994 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1263/2519] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:30:17.589433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:17.592233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:17.601523 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1257/2520] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:17.605876 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:17.617415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c987af9-cb89-42bd-b149-efae96d5ff2e service glance] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:17.622993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:17.623977 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.624254 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.624521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.625167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:30:17.625495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:17.627195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:17.639983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1264/2521] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:30:17.652610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:17.662787 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be841c66-c5a4-461a-ba84-e8a0ecd35aa6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:17.667506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:17.668132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.668404 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.668670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.669334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:17.671230 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758868-afce-412b-827f-2e0419b34598 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:17.845753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1258/2522] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:17.851166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:17.861595 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8e51e-cf5e-48a2-93fc-42e43b5598db admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:17.907237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:17.920912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:17.921518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.921791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.922055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.922712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:17.924822 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:17.951036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe356bf-58fb-4ef6-87d8-85816f08e79d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.951315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe356bf-58fb-4ef6-87d8-85816f08e79d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.952141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe356bf-58fb-4ef6-87d8-85816f08e79d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.953028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1259/2523] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:30:17.958162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:17.958583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:17.959427 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:17.979961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] MFA Rules not processed for user `c637175771de4971a667a9687cfb7e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:17.981204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:18.032492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1260/2524] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:30:18.045429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.046798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:18.057632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa94f-fbfc-4d49-800c-9d249e823a9c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.061315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.061921 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.062196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.062465 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.070515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.071944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.077741 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1265/2525] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:17 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:18.078849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.080650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1261/2526] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:30:18.091552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6f82-74e4-4561-91c3-3036035fdc50 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.097236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.098018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.098506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.098846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.099490 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.101145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.112861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1266/2527] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:18.117075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.132098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9665443-e00b-4180-8ff5-6ea74fc371fa service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.138593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.139214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.139491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.139786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.140445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.142109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc06e8-8751-4edb-a44d-9cafc24b7c21 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.153344 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1262/2528] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:18.157750 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.169838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaad8-e469-42d5-b54f-b0760bdc78f5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.174734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16b0e-2940-4694-9dca-f605ad4d0176 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.174889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.175103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16b0e-2940-4694-9dca-f605ad4d0176 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.175466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.175594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16b0e-2940-4694-9dca-f605ad4d0176 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.175748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.176124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] PATH_INFO: `/v3/projects/118b6da72fa44b37a4ff435fe7e3ee84/users/f9807640cd2142638f5089b1f0387349/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.177582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1263/2529] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 18:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 18:30:18.183552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.183938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.184315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.192966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118b6da72fa44b37a4ff435fe7e3ee84, user_id=f9807640cd2142638f5089b1f0387349, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.195645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c38dc-a350-4e80-b0b5-d08fee3b03c0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.204681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] MFA Rules not processed for user `f66707e00ece419d9cc33f09ba016e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:18.205871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:18.277953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1264/2530] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:18.288486 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.297880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6864a-36d1-452c-bd76-1b860f25a717 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.301843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.302445 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.302845 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.303136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.308113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1267/2531] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:18 2022] PUT /identity/v3/projects/118b6da72fa44b37a4ff435fe7e3ee84/users/f9807640cd2142638f5089b1f0387349/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:18.313728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.319147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.326975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1265/2532] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:30:18.329720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.329900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.330149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.366052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] MFA Rules not processed for user `f9807640cd2142638f5089b1f0387349`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:18.367403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:18.449259 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1268/2533] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:18.453862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.468952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8ff2-b04b-49a0-aebe-450580357c9e service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.494518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:18.552468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.553041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.553318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.553584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.554207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.567281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.640441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1266/2534] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:18 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:30:18.644486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.656184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4963fe1-0754-4a8a-a1bf-cd0d4552b5a5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.716734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.717261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.717537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.717958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.718455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.720427 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.851740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1269/2535] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:18 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:18.856469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.868820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5232a8c-6ca2-4dec-9702-bead5bf5a15e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.874040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.874681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.874950 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.875222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.875900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.883572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.902408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1267/2536] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:18.903987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.915445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c63b6-77a0-41ad-9cda-83ac43914480 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.920346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.921029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.921401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.921772 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.922578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.924314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39761517-d6f9-48ae-a4e6-d8541f5b8fb0 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:18.935445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1270/2537] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:18.941987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:18.953515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d931f1-65a2-496f-a310-51f25d852aef admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:18.959009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:18.960729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:18.960729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:18.960729 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] PATH_INFO: `/v3/projects/edbc55d94fc34f4d86d413e74e0d6c57/users/3dfee013e9184cc7b8b837c38b0e04a5/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:18.975221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbc55d94fc34f4d86d413e74e0d6c57, user_id=3dfee013e9184cc7b8b837c38b0e04a5, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:18.977849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.063202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1268/2538] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:18 2022] PUT /identity/v3/projects/edbc55d94fc34f4d86d413e74e0d6c57/users/3dfee013e9184cc7b8b837c38b0e04a5/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:19.074369 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.074627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.081245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.096445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:19.106504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] MFA Rules not processed for user `3dfee013e9184cc7b8b837c38b0e04a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:19.107728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:19.176252 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1271/2539] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:19.181670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.258881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad99c5-a5d5-4acf-908a-a25282143837 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.263826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.264435 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.264713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.264974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.265589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.267527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.368484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1269/2540] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:19 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:19.373930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.388014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ba351-9b90-4caf-aaf7-55620f41aaab None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.455372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.456035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.456330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.456649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.457841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.460031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.595099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1272/2541] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:19 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:19.599511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.612223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f4ba-d8fd-42a6-9899-402d83638618 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.618291 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.619335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.619704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.620737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.620737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.622443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.643802 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1270/2542] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:19.646726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.660417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22698-bd44-41ce-96cd-7c82d93c3002 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.666274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.667367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.667367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.667545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] PATH_INFO: `/v3/projects/656d0b718ef44a04b5e524d4a50b39ec/users/d07498ca890146a5b72aa417129b3d3f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.684684 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=656d0b718ef44a04b5e524d4a50b39ec, user_id=d07498ca890146a5b72aa417129b3d3f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.687399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.788455 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1273/2543] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:19 2022] PUT /identity/v3/projects/656d0b718ef44a04b5e524d4a50b39ec/users/d07498ca890146a5b72aa417129b3d3f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:19.800432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.812234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a61-7f02-468e-917f-2ba56a9ce995 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.860038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:19.880222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.881081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.881364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.881633 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.882272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.883937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665b6a-29aa-46ee-af59-2b76c2150733 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.895217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1271/2544] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:30:19.900065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:19.916420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89068d1-2e0b-46dd-9f81-fbd5e637d20a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:19.922491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:19.923169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.923474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.923742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] PATH_INFO: `/v3/projects/656d0b718ef44a04b5e524d4a50b39ec/users/d07498ca890146a5b72aa417129b3d3f/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.925756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=656d0b718ef44a04b5e524d4a50b39ec, user_id=d07498ca890146a5b72aa417129b3d3f, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:19.929630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:19.941036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1274/2545] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:19 2022] PUT /identity/v3/projects/656d0b718ef44a04b5e524d4a50b39ec/users/d07498ca890146a5b72aa417129b3d3f/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:30:19.953624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773916d-8365-4d3d-bbef-7426e25710ba None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:19.953933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773916d-8365-4d3d-bbef-7426e25710ba None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:19.954203 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773916d-8365-4d3d-bbef-7426e25710ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:19.982851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8773916d-8365-4d3d-bbef-7426e25710ba None None] MFA Rules not processed for user `d07498ca890146a5b72aa417129b3d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:19.984112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8773916d-8365-4d3d-bbef-7426e25710ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:20.072593 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1272/2546] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:20.085610 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:20.087547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:20.159324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52171b-b200-4e67-987d-dd9e211961fe admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:20.164078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:20.172655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:20.172655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:20.172655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:20.172655 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:20.175222 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:20.176870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:20.188414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1275/2547] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:21.059574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:21.061363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:21.061363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:21.079463 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:21.080698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:21.139478 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1273/2548] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:21.155574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:21.155574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:21.257338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75454-2bbf-4696-a0a7-eadc6f1e6062 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:21.262464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:21.263076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:21.263354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:21.263623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:21.273669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:21.276249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:21.291632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1276/2549] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 18:30:21.335245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:21.336880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:21.348794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb9b17-9843-44e0-bd7c-f74a6625efc5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:21.354223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:21.355023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:21.355345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:21.355795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:21.433530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:21.434976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:21.445540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1274/2550] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:29.279131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:29.294510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87d532-67e6-4e9f-bd21-266730f01c91 service swift] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:29.298926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:29.299643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:29.299918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:29.300153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:29.399009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:29.401962 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c042a8-a91c-4b6c-ada8-1debd4a83ebc service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:29.421135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1277/2551] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:30:31.440303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:36.287218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:36.356589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15ddbf-8db1-4396-a35e-0b25a6356d95 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:36.361948 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:36.362641 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:36.362922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:36.363191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] PATH_INFO: `/v3/users/f9807640cd2142638f5089b1f0387349` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:36.364998 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9807640cd2142638f5089b1f0387349)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:36.366927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:36.597342 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9807640cd2142638f5089b1f0387349'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:36.605374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9807640cd2142638f5089b1f0387349'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:36.696053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9807640cd2142638f5089b1f0387349'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:36.696748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9807640cd2142638f5089b1f0387349'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:36.712390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9807640cd2142638f5089b1f0387349'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:36.720524 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1275/2552] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:36 2022] DELETE /identity/v3/users/f9807640cd2142638f5089b1f0387349 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:36.723727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:36.724503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:36.724503 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:36.747865 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:36.749641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:36.825036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1278/2553] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:36.836401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:36.837905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:36.934098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256057e3-6d33-41e4-9709-2a8e80d38136 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:36.938109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:36.938796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:36.939136 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:36.939472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:36.951493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:36.953157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:36.967318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1276/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:37.446229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:37.447782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:37.466272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb834-0f39-44b3-839f-e607157f24b2 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:37.475321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:37.475321 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:37.476145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:37.476145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] PATH_INFO: `/v3/projects/118b6da72fa44b37a4ff435fe7e3ee84` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:37.477136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118b6da72fa44b37a4ff435fe7e3ee84)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:37.479099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:37.507541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:37.619579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118b6da72fa44b37a4ff435fe7e3ee84', 'request_id': 'req-99c4dad5-50aa-4896-9cd0-d5af56d23168'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:37.627050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118b6da72fa44b37a4ff435fe7e3ee84', 'request_id': 'req-99c4dad5-50aa-4896-9cd0-d5af56d23168'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:37.691662 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118b6da72fa44b37a4ff435fe7e3ee84', 'request_id': 'req-99c4dad5-50aa-4896-9cd0-d5af56d23168'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:37.708078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] The token cache is being invalidate because project 118b6da72fa44b37a4ff435fe7e3ee84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:37.709139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:37.711488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:37.713060 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1279/2555] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:37 2022] DELETE /identity/v3/projects/118b6da72fa44b37a4ff435fe7e3ee84 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:37.717372 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:37.744830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f0735-5a8c-4892-b116-f4463bc60bb0 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:37.764696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:37.813438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:37.814236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:37.814637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:37.815010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] PATH_INFO: `/v3/users/3dfee013e9184cc7b8b837c38b0e04a5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:37.816270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfee013e9184cc7b8b837c38b0e04a5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:37.818840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:38.064241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfee013e9184cc7b8b837c38b0e04a5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.073894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfee013e9184cc7b8b837c38b0e04a5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.164966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfee013e9184cc7b8b837c38b0e04a5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.165370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfee013e9184cc7b8b837c38b0e04a5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.179622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfee013e9184cc7b8b837c38b0e04a5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.186591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1277/2556] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:37 2022] DELETE /identity/v3/users/3dfee013e9184cc7b8b837c38b0e04a5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:38.664342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:38.665955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:38.683457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4dad5-50aa-4896-9cd0-d5af56d23168 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:38.761015 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:38.763838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:38.764126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:38.764402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] PATH_INFO: `/v3/projects/edbc55d94fc34f4d86d413e74e0d6c57` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:38.765701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbc55d94fc34f4d86d413e74e0d6c57)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:38.767718 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:38.893884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbc55d94fc34f4d86d413e74e0d6c57', 'request_id': 'req-1d31ea63-656a-413e-b430-985b9fd5ebce'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:38.900628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbc55d94fc34f4d86d413e74e0d6c57', 'request_id': 'req-1d31ea63-656a-413e-b430-985b9fd5ebce'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.033351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbc55d94fc34f4d86d413e74e0d6c57', 'request_id': 'req-1d31ea63-656a-413e-b430-985b9fd5ebce'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.046733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] The token cache is being invalidate because project edbc55d94fc34f4d86d413e74e0d6c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:39.046963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.047537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.049180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1280/2557] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:38 2022] DELETE /identity/v3/projects/edbc55d94fc34f4d86d413e74e0d6c57 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:39.053279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:39.055103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:39.068651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa03e0-d4a8-4ac8-819a-21b51c551c4a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:39.143366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:39.144150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:39.144299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:39.144576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] PATH_INFO: `/v3/users/d07498ca890146a5b72aa417129b3d3f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:39.146811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07498ca890146a5b72aa417129b3d3f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:39.148823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:39.340189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:39.343365 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07498ca890146a5b72aa417129b3d3f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.352695 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07498ca890146a5b72aa417129b3d3f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.429122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07498ca890146a5b72aa417129b3d3f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.429785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07498ca890146a5b72aa417129b3d3f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.446198 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e3961b61-36a2-41f1-b295-fb78f674aba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07498ca890146a5b72aa417129b3d3f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:39.452984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1278/2558] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:39 2022] DELETE /identity/v3/users/d07498ca890146a5b72aa417129b3d3f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:39.955587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:39.957154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:39.972370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ea63-656a-413e-b430-985b9fd5ebce admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.039141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:40.070621 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.071370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.071547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.071979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] PATH_INFO: `/v3/projects/656d0b718ef44a04b5e524d4a50b39ec` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.073318 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=656d0b718ef44a04b5e524d4a50b39ec)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.075345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.185233 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656d0b718ef44a04b5e524d4a50b39ec', 'request_id': 'req-c7573e2a-b73a-4c3d-aa56-c80e297122cf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:40.193383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656d0b718ef44a04b5e524d4a50b39ec', 'request_id': 'req-c7573e2a-b73a-4c3d-aa56-c80e297122cf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:40.257506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656d0b718ef44a04b5e524d4a50b39ec', 'request_id': 'req-c7573e2a-b73a-4c3d-aa56-c80e297122cf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:40.270988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] The token cache is being invalidate because project 656d0b718ef44a04b5e524d4a50b39ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:40.271301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:40.272285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-c7573e2a-b73a-4c3d-aa56-c80e297122cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:40.274716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1281/2559] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:39 2022] DELETE /identity/v3/projects/656d0b718ef44a04b5e524d4a50b39ec => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:40.281674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.282202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.282202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.318064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:40.319419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:40.418723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1279/2560] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:40.427336 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.427825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.428151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.449821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:40.450046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:40.458747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1282/2561] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:40.463119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.473900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dec8e-30a7-4458-bc01-0539796858ef None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.481841 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.482331 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.482688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.483024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.483686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:30:40.484022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.485742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.500768 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1280/2562] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:30:40.505575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.515551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5057a-11ec-4703-979c-8912bbafab87 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.524696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.525140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.525487 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.525920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.526641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.528946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.675357 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1283/2563] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:40 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:40.681161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.691896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792af9-a132-429e-961d-0cce956ceee0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.776812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.777452 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.777724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.778555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.778555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.780922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.890849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1281/2564] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:40 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:40.895056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.910611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae0cd6-fd61-495a-aa78-5d4a117cfa90 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.916280 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.916914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.917220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.917483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.918116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.919709 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.931448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1284/2565] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:40.935783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.947995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122ef5d-b2bf-4e35-9c27-076ad872cfe5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.952991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.953392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.957163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.957163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:40.957163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:40.957163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d54097-7980-4fd2-bb52-687cb20c7307 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:40.969111 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1282/2566] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:40.973511 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:40.984507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef8bea-3abc-4281-a070-d90e21eceba7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:40.989207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:40.990476 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:40.990767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:40.991029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] PATH_INFO: `/v3/projects/707c25f65359439e959a898823a6656c/users/7468b55bdae2486eaf0ce0d6cce45eae/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.008533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] RBAC: Authorizing `identity:create_grant(project_id=707c25f65359439e959a898823a6656c, user_id=7468b55bdae2486eaf0ce0d6cce45eae, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.011208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.097407 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1285/2567] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:40 2022] PUT /identity/v3/projects/707c25f65359439e959a898823a6656c/users/7468b55bdae2486eaf0ce0d6cce45eae/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:41.118737 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.118989 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.119261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.154231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] MFA Rules not processed for user `7468b55bdae2486eaf0ce0d6cce45eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:41.155458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:41.169549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:41.227263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1283/2568] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:41.236429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.304018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227b4f8-9b1a-4cd2-ba10-32f9ff99555e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.308857 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.309461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.309735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.310000 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.310629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.312571 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.318248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:41.435237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1286/2569] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:41 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:30:41.441332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.453979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01af10-423c-4f9d-9167-6847a855565a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.515144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.515674 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.515971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.516244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.516865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.518804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.607751 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1284/2570] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:41 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:41.611803 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.634713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454427e8-092b-4fb7-abe8-c646853ed0d1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.639687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.640343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.640910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.640910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.641602 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.643271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.658948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1287/2571] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:30:41.660661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.671345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae89f4-6abe-4a5e-8864-c8ed5176a18f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.676678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.677497 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.677767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.678100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] PATH_INFO: `/v3/projects/d1245ac2389143588b07e5038724196d/users/bc387565cea24b8f884c301625988202/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.698123 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1245ac2389143588b07e5038724196d, user_id=bc387565cea24b8f884c301625988202, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.701008 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.785294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1285/2572] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:41 2022] PUT /identity/v3/projects/d1245ac2389143588b07e5038724196d/users/bc387565cea24b8f884c301625988202/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:41.785810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.796788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea170ce-3280-47ab-9dab-bc516266aaed admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.913978 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.915398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.916198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.925166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.925166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.925166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe572b-e769-4bfe-b165-208507703c9f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.930247 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1288/2573] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:41.934774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:41.946732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987648d-45f4-4e10-846d-3a2358dc2166 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:41.957939 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:41.958812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.959094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.959370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] PATH_INFO: `/v3/projects/d1245ac2389143588b07e5038724196d/users/bc387565cea24b8f884c301625988202/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:41.961472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1245ac2389143588b07e5038724196d, user_id=bc387565cea24b8f884c301625988202, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:41.964701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:41.980103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1286/2574] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:41 2022] PUT /identity/v3/projects/d1245ac2389143588b07e5038724196d/users/bc387565cea24b8f884c301625988202/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:41.992251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:41.992740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:41.993114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:42.059507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] MFA Rules not processed for user `bc387565cea24b8f884c301625988202`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:42.060787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:42.135379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1289/2575] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:30:42.147707 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:42.149422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:42.222029 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b272-4648-4a98-9218-b9f08aebac84 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:42.225945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:42.226563 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:42.226867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:42.227131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:42.236884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:42.238953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2792-2edf-4e27-a747-b2c4cce2edd0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:42.249537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1287/2576] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:42.818569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:42.882006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:42.886710 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed342a-ef9b-4826-be32-8ff14ecb2da7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:42.892399 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:42.893072 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:42.893349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:42.893619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] PATH_INFO: `/v3/users/7468b55bdae2486eaf0ce0d6cce45eae` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:42.894999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7468b55bdae2486eaf0ce0d6cce45eae)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:42.897105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:43.062888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7468b55bdae2486eaf0ce0d6cce45eae'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:43.158815 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7468b55bdae2486eaf0ce0d6cce45eae'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:43.175900 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7468b55bdae2486eaf0ce0d6cce45eae'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:43.178081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7468b55bdae2486eaf0ce0d6cce45eae'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:43.179437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7468b55bdae2486eaf0ce0d6cce45eae'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:43.193930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1290/2577] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:42 2022] DELETE /identity/v3/users/7468b55bdae2486eaf0ce0d6cce45eae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:43.199002 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:43.199634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:43.199634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:43.222865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:43.224666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:43.230444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:43.291208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1288/2578] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:43.303518 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:43.304107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:43.372589 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26a181-47c9-4cb8-bc5b-1fa37ecc9e68 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:43.376569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:43.377175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:43.377448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:43.377714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:43.387202 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:43.388606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:43.398236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1291/2579] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:30:43.869748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:43.871198 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:43.886749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c02ffc-457e-4f17-870d-78b3b4cce3de None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:43.892238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:43.893047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:43.893453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:43.893940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] PATH_INFO: `/v3/projects/707c25f65359439e959a898823a6656c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:43.896021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] RBAC: Authorizing `identity:delete_project(project_id=707c25f65359439e959a898823a6656c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:43.900348 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:44.041607 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707c25f65359439e959a898823a6656c', 'request_id': 'req-584f6c7e-311e-4a91-99ab-9c62bf71469a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.050148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707c25f65359439e959a898823a6656c', 'request_id': 'req-584f6c7e-311e-4a91-99ab-9c62bf71469a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.119241 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707c25f65359439e959a898823a6656c', 'request_id': 'req-584f6c7e-311e-4a91-99ab-9c62bf71469a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.131704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] The token cache is being invalidate because project 707c25f65359439e959a898823a6656c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:44.132019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.132689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-584f6c7e-311e-4a91-99ab-9c62bf71469a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.134175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1289/2580] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:43 2022] DELETE /identity/v3/projects/707c25f65359439e959a898823a6656c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:44.140903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:44.152166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15b53-f068-435f-8115-00b0fdf3d52b service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:44.248050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:44.249138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:44.249421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:44.249816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] PATH_INFO: `/v3/users/bc387565cea24b8f884c301625988202` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:44.253351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc387565cea24b8f884c301625988202)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:44.255955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:44.298521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:44.508425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc387565cea24b8f884c301625988202'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.553417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc387565cea24b8f884c301625988202'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.568287 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc387565cea24b8f884c301625988202'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.569030 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc387565cea24b8f884c301625988202'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.569849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc387565cea24b8f884c301625988202'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:44.585827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1292/2581] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:30:44 2022] DELETE /identity/v3/users/bc387565cea24b8f884c301625988202 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:44.668855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:44.669388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:44.669647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:44.725947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:44.727173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:44.800756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1290/2582] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:44.814001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:44.815408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:44.931066 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb46be-1d72-40f4-b5a4-9023cb1c4c3a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:44.936944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:44.937556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:44.937831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:44.938122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:44.949409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:44.951024 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b125-8b4f-4baa-9e65-5f5132fe40e1 service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:44.960617 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1293/2583] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:30:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:30:45.047817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.049829 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:45.061458 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:45.127553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c65f05-9f1c-490a-ac7c-679debeeee32 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.133459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.134103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.134399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.134648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] PATH_INFO: `/v3/projects/d1245ac2389143588b07e5038724196d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.135843 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1245ac2389143588b07e5038724196d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.137758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.262369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1245ac2389143588b07e5038724196d', 'request_id': 'req-878417d7-4835-4362-b607-0c5c392a0205'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:45.270555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1245ac2389143588b07e5038724196d', 'request_id': 'req-878417d7-4835-4362-b607-0c5c392a0205'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:45.347888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1245ac2389143588b07e5038724196d', 'request_id': 'req-878417d7-4835-4362-b607-0c5c392a0205'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:45.359995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] The token cache is being invalidate because project d1245ac2389143588b07e5038724196d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:30:45.360284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:45.360926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-878417d7-4835-4362-b607-0c5c392a0205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:30:45.362662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1291/2584] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:30:45 2022] DELETE /identity/v3/projects/d1245ac2389143588b07e5038724196d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:45.368824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97572757-6271-4c65-89b5-56e3db30139d None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.369377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97572757-6271-4c65-89b5-56e3db30139d None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.369377 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97572757-6271-4c65-89b5-56e3db30139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.390457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-97572757-6271-4c65-89b5-56e3db30139d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:45.391668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-97572757-6271-4c65-89b5-56e3db30139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:45.463798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1294/2585] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:45.484774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.485061 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.485319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.508536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:45.509969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:45.518227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1292/2586] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:45.522733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97572757-6271-4c65-89b5-56e3db30139d None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.532533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97572757-6271-4c65-89b5-56e3db30139d None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.537416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.538085 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.538388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.546011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.546011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:30:45.546011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.546011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.546011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:45.556647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1295/2587] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:30:45.558537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.569941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69edc6-d78f-40d8-9c3a-cdb880977825 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.574277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.574888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.575164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.575433 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.576080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.577987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.678495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1293/2588] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:30:45 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:45.680439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.690040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813f0e-a576-4641-a0de-971b2df01802 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.751569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.752208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.752483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.752771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.753359 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.755945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.844350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1296/2589] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:30:45 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:30:45.845548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.856839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137919ba-5429-4519-b45d-0e356db9db4e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.861708 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.862311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.863870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.863870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.863870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.865891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.880192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1294/2590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:30:45.881704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.892542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a605d1d-3b63-4765-8ea7-973a26f3c0e6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.898114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.898728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.899034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.899308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.899990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.901707 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1865ea2-7288-41ff-ab46-fd5802b2d575 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:45.914176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1297/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:30:45.918417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:45.929683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac27c-da7b-4452-bdc9-d9c51b78be3f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:45.934799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:45.935115 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:45.935391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:45.935660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] PATH_INFO: `/v3/projects/ec1cb26bc1f0425d92b185dcf3ec1731/users/c94466bb805b48feadec09f5101601a4/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:45.951174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1cb26bc1f0425d92b185dcf3ec1731, user_id=c94466bb805b48feadec09f5101601a4, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:45.953883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:46.040081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1295/2592] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:30:45 2022] PUT /identity/v3/projects/ec1cb26bc1f0425d92b185dcf3ec1731/users/c94466bb805b48feadec09f5101601a4/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:30:46.051394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:46.051678 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:46.052613 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:46.082824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] MFA Rules not processed for user `c94466bb805b48feadec09f5101601a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:30:46.084705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:46.153140 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1298/2593] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:30:46.166303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:30:46.168152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:30:46.204440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:46.231393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa8c3-8d96-4e10-8090-5766ccc261f3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:30:46.235163 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:30:46.235808 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:30:46.236096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:30:46.236369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:30:46.246472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:30:46.247963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c074-8fd5-46c1-bebc-98eea862ca81 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:30:46.259592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1296/2594] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:30:56.149102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:30:56.661421 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=11 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:03.529288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:03.598078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c01021-56c4-4658-a57f-ff10e0aa45aa None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:03.603234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:03.603882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:03.604152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:03.604426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] PATH_INFO: `/v3/users/c94466bb805b48feadec09f5101601a4` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:03.605540 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94466bb805b48feadec09f5101601a4)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:03.607448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:03.831520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94466bb805b48feadec09f5101601a4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:03.912640 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94466bb805b48feadec09f5101601a4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:03.926887 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94466bb805b48feadec09f5101601a4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:03.928448 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94466bb805b48feadec09f5101601a4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:03.929470 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94466bb805b48feadec09f5101601a4'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:03.944502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1299/2595] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:03 2022] DELETE /identity/v3/users/c94466bb805b48feadec09f5101601a4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:03.948901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:03.949420 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:03.950210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:03.969616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:03.970827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:04.061094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1297/2596] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:31:04.073042 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:04.074581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:04.149694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd43d-f5ad-49da-adcd-78ea75bb54d7 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:04.154486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:04.155101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:04.155372 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:04.155651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:04.167775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:04.169440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde3c8a-0753-4b9d-b903-3ec916328c5b service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:04.179922 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1300/2597] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:04.756679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:04.760096 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:04.789922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc837-bcd8-474c-9d03-1652fd88170e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:04.798197 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:04.799494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:04.800171 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:04.800814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] PATH_INFO: `/v3/projects/ec1cb26bc1f0425d92b185dcf3ec1731` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:04.803727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1cb26bc1f0425d92b185dcf3ec1731)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:04.808172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:04.955228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1cb26bc1f0425d92b185dcf3ec1731', 'request_id': 'req-703f7689-5f37-4705-82ca-8681dab60c6f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:04.963035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1cb26bc1f0425d92b185dcf3ec1731', 'request_id': 'req-703f7689-5f37-4705-82ca-8681dab60c6f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:05.076992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1cb26bc1f0425d92b185dcf3ec1731', 'request_id': 'req-703f7689-5f37-4705-82ca-8681dab60c6f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:05.090293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] The token cache is being invalidate because project ec1cb26bc1f0425d92b185dcf3ec1731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:05.090579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:05.091238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-703f7689-5f37-4705-82ca-8681dab60c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:05.092772 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1298/2598] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:04 2022] DELETE /identity/v3/projects/ec1cb26bc1f0425d92b185dcf3ec1731 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:05.100172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.100729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.100729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.127050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:05.128317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:05.146847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:05.193661 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1301/2599] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:31:05.206930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.207234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.208035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.229770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:05.230994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:05.239886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1299/2600] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:05.244152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.254461 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf73c2-3cd9-49d4-b3ce-1adcaab5aae5 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.259884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.260622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.260990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.261354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.262119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:31:05.262524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.264283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.278548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1302/2601] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:31:05.283287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.294809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cd5d5-fdd0-4fbc-af84-42fa3ed3ad15 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.299664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.300444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.300724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.301000 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.302253 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.304533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.395341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1300/2602] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:05 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:05.399705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.410409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f80c8-28b9-4080-b7bc-f160a5ab9cde admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.482675 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.483277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.483551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.483920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.484466 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.486554 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.576301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1303/2603] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:05 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:05.580455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.600521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e1196-d7b9-4f97-a0d9-1807bbbb6abf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.605868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.606475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.606753 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.607042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.607666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.609311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.621188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1301/2604] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:05.627631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.641644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece30f19-3d4b-423d-9c74-1bf415aa5a69 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.647748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.648406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.648782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.649065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.649712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.651329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee8c9-62f8-4e2f-93b0-aa96b11a4572 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.665306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1304/2605] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:31:05.669570 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.680626 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f618-a423-49c3-841f-e2d8b01ccc25 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:05.685554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:05.686217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.686495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.686771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] PATH_INFO: `/v3/projects/8084c45788994376b4eaf24163c99eb2/users/561648e1b4d448a38b0c78438c9f0842/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.706970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8084c45788994376b4eaf24163c99eb2, user_id=561648e1b4d448a38b0c78438c9f0842, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:05.712180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:05.788500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1302/2606] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:05 2022] PUT /identity/v3/projects/8084c45788994376b4eaf24163c99eb2/users/561648e1b4d448a38b0c78438c9f0842/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:05.798723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:05.799007 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:05.799319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:05.829155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] MFA Rules not processed for user `561648e1b4d448a38b0c78438c9f0842`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:05.830373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:05.920547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1305/2607] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:05.933731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:05.935594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:05.960423 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:06.003647 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d09a34-f4a5-4e15-b34b-3edaf4553a57 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:06.010382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:06.015272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:06.015941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:06.016224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:06.032258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:06.033701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ff254-2ee0-44a0-9aa9-6017a904934a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:06.045067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1303/2608] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:06.072800 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:06.106368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:06.155298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd4b4-0b7c-43ec-9435-6ba3b1442371 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:06.160003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:06.164341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:06.164341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:06.164341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] PATH_INFO: `/v3/users/561648e1b4d448a38b0c78438c9f0842` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:06.164341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=561648e1b4d448a38b0c78438c9f0842)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:06.165131 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:06.342190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561648e1b4d448a38b0c78438c9f0842'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:06.415650 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561648e1b4d448a38b0c78438c9f0842'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:06.428969 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561648e1b4d448a38b0c78438c9f0842'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:06.429668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561648e1b4d448a38b0c78438c9f0842'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:06.430300 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561648e1b4d448a38b0c78438c9f0842'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:06.443292 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1306/2609] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:06 2022] DELETE /identity/v3/users/561648e1b4d448a38b0c78438c9f0842 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:06.448138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:06.448422 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:06.448692 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:06.476798 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:06.478025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:06.542351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1304/2610] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:06.552604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:06.554006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:06.620659 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ef02-e778-4cb5-b650-4468832d3fc6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:06.624776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:06.625383 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:06.625880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:06.626385 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:06.637964 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:06.639465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:06.650255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1307/2611] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:31:07.063783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:07.069698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:07.087639 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92849-7757-4eec-88cb-b1cdf5840ff3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:07.099285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:07.100671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:07.101287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:07.101868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] PATH_INFO: `/v3/projects/8084c45788994376b4eaf24163c99eb2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:07.104151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8084c45788994376b4eaf24163c99eb2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:07.108740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:07.235275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8084c45788994376b4eaf24163c99eb2', 'request_id': 'req-2049703d-49e4-4e1a-b29c-08d77a4b297b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:07.242644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8084c45788994376b4eaf24163c99eb2', 'request_id': 'req-2049703d-49e4-4e1a-b29c-08d77a4b297b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:07.324258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8084c45788994376b4eaf24163c99eb2', 'request_id': 'req-2049703d-49e4-4e1a-b29c-08d77a4b297b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:07.339711 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] The token cache is being invalidate because project 8084c45788994376b4eaf24163c99eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:07.340223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:07.340961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:07.342568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1305/2612] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:07 2022] DELETE /identity/v3/projects/8084c45788994376b4eaf24163c99eb2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:12.671515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:12.672982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:12.714101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:12.715591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:12.721779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:12.737250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35520-cb2d-4699-8d2f-64eceb260985 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:12.774247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:12.789021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:12.789622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:12.789895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:12.790164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:12.792782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:12.800144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049703d-49e4-4e1a-b29c-08d77a4b297b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:12.805972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:12.806826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:12.807102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:12.807368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:12.809224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:12.879620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:12.881231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:12.885929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:12.887569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:12.902504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1308/2613] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:12.907415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1306/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:31:17.894862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:17.908583 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53678df-91a2-48c9-97f1-5c5229da9ac5 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:17.914154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:17.914768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:17.915038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:17.915305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:17.917758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:17.930818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:17.940456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:17.949756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1309/2615] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:18.926120 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:18.927852 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:19.001208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3292-b4e3-45ca-822e-24ada8916c20 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:19.005217 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:19.005824 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:19.006095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:19.006360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:19.008132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:19.026373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:19.027890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:19.037673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1307/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:25.473162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:25.483330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b6ea-9803-4713-b86e-6526f5d49683 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:25.487230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:25.487992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:25.488238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:25.488482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:25.490195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:25.554244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:25.556829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:25.567749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1310/2617] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:29.032946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=70 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:29.349170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:29.350595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:29.365449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb41a6-6827-4a00-9516-290c1dd6d240 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:29.370899 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:29.371532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:29.371835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:29.372109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] PATH_INFO: `/v3/users/bf2cab4aebe54e44aff07c25182b8663` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:29.373260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2cab4aebe54e44aff07c25182b8663)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:29.375439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:29.509210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2cab4aebe54e44aff07c25182b8663'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:29.516378 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2cab4aebe54e44aff07c25182b8663'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:29.586541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2cab4aebe54e44aff07c25182b8663'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:29.588333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2cab4aebe54e44aff07c25182b8663'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:29.601405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd80d56e-5c57-4669-a6f4-63c417a6b81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2cab4aebe54e44aff07c25182b8663'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:29.608192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1308/2618] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:29 2022] DELETE /identity/v3/users/bf2cab4aebe54e44aff07c25182b8663 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:29.874333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:29.879446 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:29.888413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f0ee-be3a-4cb4-bc2b-5047fe9ca595 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:29.946100 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:29.948680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:29.948953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:29.949439 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] PATH_INFO: `/v3/projects/56d58d25666b4b7da1a58ce982fe1fc5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:29.950381 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d58d25666b4b7da1a58ce982fe1fc5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:29.952356 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.097221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d58d25666b4b7da1a58ce982fe1fc5', 'request_id': 'req-3b73fda5-1fba-4562-86f4-83e8005664a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:30.106429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d58d25666b4b7da1a58ce982fe1fc5', 'request_id': 'req-3b73fda5-1fba-4562-86f4-83e8005664a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:30.181787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d58d25666b4b7da1a58ce982fe1fc5', 'request_id': 'req-3b73fda5-1fba-4562-86f4-83e8005664a7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:30.192926 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] The token cache is being invalidate because project 56d58d25666b4b7da1a58ce982fe1fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:30.193217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:30.193944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-3b73fda5-1fba-4562-86f4-83e8005664a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:30.195426 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1311/2619] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:29 2022] DELETE /identity/v3/projects/56d58d25666b4b7da1a58ce982fe1fc5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:30.201164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.201723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.201820 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.221428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:30.222649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:30.286334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1309/2620] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:30.294585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.294896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.295170 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.315416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:30.316714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:30.325669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1312/2621] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:30.330007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.340269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a640d1-0245-4c58-bd03-614133acbc04 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.344844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.345448 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.345720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.345985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.346630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:31:30.346926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.348578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.360714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1310/2622] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:31:30.365262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.375869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e760f6-6ca5-4f68-9e34-7ccc111e9b45 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.380547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.384859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.384859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.384859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.384859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.384859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.515176 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1313/2623] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:30 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:30.519481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.530550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c209d3-d251-4db0-8e8e-810398c97bb2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.586760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.588276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.588560 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.588833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.589459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.591479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.599651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:30.736611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1311/2624] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:30 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:31:30.740825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.752246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45eede-a6e3-4e24-abd6-1fdf58a9991c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.756955 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.757552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.757830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.758098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.759245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.760923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.771191 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1314/2625] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:30.775991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.786871 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d64bc-b5ce-436a-a9cc-fd1b542a574f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.791890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.792493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.792770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.793045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.793665 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.795289 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f99c-aa48-4d75-9e68-0061cbb616c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.806383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1312/2626] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:30.814366 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:30.825332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43984-66a9-40d5-985b-ee577d14b8b1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:30.829888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:30.830599 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.830884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.831156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] PATH_INFO: `/v3/projects/6e1c08d6a6054222b6fbfc65dcfd9d44/users/ef4577b399654f8f90c6489303a54385/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.847105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1c08d6a6054222b6fbfc65dcfd9d44, user_id=ef4577b399654f8f90c6489303a54385, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:30.849850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:30.958502 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1315/2627] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:30 2022] PUT /identity/v3/projects/6e1c08d6a6054222b6fbfc65dcfd9d44/users/ef4577b399654f8f90c6489303a54385/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:30.968863 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:30.969138 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:30.969405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:30.997898 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] MFA Rules not processed for user `ef4577b399654f8f90c6489303a54385`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:30.999351 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:31.063589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1313/2628] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:31.076002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:31.077702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:31.109478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:31.156779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be531-ddc1-4ec3-9890-23a24bf6bf4e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:31.162587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:31.168313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:31.168313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:31.168313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:31.172245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:31.173931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16798b2-5a72-4f0b-92de-2cd53e2bd557 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:31.183639 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1316/2629] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:31.402669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:31.465483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801ef6-7c7a-494e-99c4-ebfa271e78a7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:31.469995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:31.470621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:31.470894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:31.471164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] PATH_INFO: `/v3/users/ef4577b399654f8f90c6489303a54385` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:31.472317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4577b399654f8f90c6489303a54385)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:31.474233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:31.680248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4577b399654f8f90c6489303a54385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:31.686951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4577b399654f8f90c6489303a54385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:31.764022 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4577b399654f8f90c6489303a54385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:31.764752 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4577b399654f8f90c6489303a54385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:31.770604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:31.778350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4577b399654f8f90c6489303a54385'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:31.784557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1314/2630] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:31 2022] DELETE /identity/v3/users/ef4577b399654f8f90c6489303a54385 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:31.789406 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:31.789691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:31.791143 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:31.813387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:31.814634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:31.877079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1317/2631] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:31.887909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:31.889434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:31.948837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dac19-071c-4dbc-a269-ec86ba6cd07e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:31.952531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:31.953139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:31.953418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:31.953691 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:31.963828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:31.965278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6398113-3f4e-493a-b0da-7c4418e17194 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:31.974916 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1315/2632] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:32.411437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:32.416058 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:32.428317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceeddf-2093-4403-9ba6-c6bb78bee260 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:32.436513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:32.437231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.437601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.437769 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] PATH_INFO: `/v3/projects/6e1c08d6a6054222b6fbfc65dcfd9d44` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.438942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1c08d6a6054222b6fbfc65dcfd9d44)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:32.440983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:32.541687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1c08d6a6054222b6fbfc65dcfd9d44', 'request_id': 'req-6df89b48-efdb-4741-9d0a-c53c082b4f22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:32.548163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1c08d6a6054222b6fbfc65dcfd9d44', 'request_id': 'req-6df89b48-efdb-4741-9d0a-c53c082b4f22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:32.609642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1c08d6a6054222b6fbfc65dcfd9d44', 'request_id': 'req-6df89b48-efdb-4741-9d0a-c53c082b4f22'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:32.621989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] The token cache is being invalidate because project 6e1c08d6a6054222b6fbfc65dcfd9d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:32.622286 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:32.622921 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-6df89b48-efdb-4741-9d0a-c53c082b4f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:32.624714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1318/2633] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:32 2022] DELETE /identity/v3/projects/6e1c08d6a6054222b6fbfc65dcfd9d44 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:32.629671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.630180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.630304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.651383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:32.652634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:32.717398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1316/2634] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:32.726660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.726954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.727228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.749370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:32.750604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:32.758695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1319/2635] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:32.763540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:32.773379 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c3871-5bd8-4acf-b018-5674953ed0f2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:32.778046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:32.778640 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.778913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.779186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.779858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:31:32.780156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:32.781759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:32.794260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1317/2636] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:31:32.798641 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:32.808680 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa11608-3783-4cfc-ab95-e99d73401259 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:32.813559 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:32.814149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.814423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.814692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.815306 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:32.817246 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:32.902590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1320/2637] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:32 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:32.907104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:32.918010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310572ab-6715-48b1-b84a-dbe3215cf788 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:32.979487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:32.980134 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:32.980397 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:32.980659 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:32.981286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:32.983190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.079052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1318/2638] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:32 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:31:33.083818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.096933 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c395-bcba-4e2b-9aa2-afae71ef22cb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.132237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.132237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.132237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.132237 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.132860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.132860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.132860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:33.132860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1321/2639] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:33.134975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.147428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3417e86-53e0-412d-9dae-57137e2aee24 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.153488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.154186 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.154576 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.154880 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.155592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.157505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3715eef-47fe-44c9-a661-1367693b5715 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.159214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:33.173741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1319/2640] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:33.178238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.188796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9b8ac-05ef-4c56-a2cc-38c256eca4bb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.193506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.194221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.194501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.194765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] PATH_INFO: `/v3/projects/ff167259c7e54d3eb2f910b015119961/users/8bf2051d3af647e69d2ce21a3ea4bb5b/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.209908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff167259c7e54d3eb2f910b015119961, user_id=8bf2051d3af647e69d2ce21a3ea4bb5b, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.213156 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.376232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1322/2641] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:33 2022] PUT /identity/v3/projects/ff167259c7e54d3eb2f910b015119961/users/8bf2051d3af647e69d2ce21a3ea4bb5b/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:33.386846 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.387663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.387663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.415139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] MFA Rules not processed for user `8bf2051d3af647e69d2ce21a3ea4bb5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:33.417156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:33.482562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1320/2642] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:33.493792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.559239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57a554-9920-478f-8677-84fcce817d64 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.564291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.564889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.565167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.565435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.566055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.567997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.702925 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1323/2643] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:33 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:33.707207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.718926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196c999-460a-4ccd-abbc-7f7f903eb1f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.777979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.778589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.778897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.779172 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.779813 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.781744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.878961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1321/2644] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:33 2022] POST /identity/v3/users => generated 306 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:31:33.883348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.895038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cad982-407f-4652-bbdf-10148db89ef3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.899826 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.900435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.900708 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.900975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.901630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.903258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:33.915676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1324/2645] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:33.920251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:33.930816 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe8e6-b235-432f-9bd9-b382eaa351cd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:33.936349 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:33.937102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:33.937472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:33.937789 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] PATH_INFO: `/v3/projects/b592fcb57cca47d488a8e2bada0aaca0/users/d1e1b7fc3e2d4943a0d642cf08671920/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:33.954071 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b592fcb57cca47d488a8e2bada0aaca0, user_id=d1e1b7fc3e2d4943a0d642cf08671920, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:33.956731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:34.033469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1322/2646] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:33 2022] PUT /identity/v3/projects/b592fcb57cca47d488a8e2bada0aaca0/users/d1e1b7fc3e2d4943a0d642cf08671920/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:34.037539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:34.047651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40366f-e067-4e9d-9e47-04c91a1e5341 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:34.229447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:34.229982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:34.230265 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:34.230528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:34.231178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:34.232867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575a04e-1e15-4e8a-af7d-45f14de01466 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:34.244967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1325/2647] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:34.249501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:34.260252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b550-113b-4f16-b0bb-3d624416ac9d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:34.264993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:34.265649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:34.265922 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:34.266190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] PATH_INFO: `/v3/projects/b592fcb57cca47d488a8e2bada0aaca0/users/d1e1b7fc3e2d4943a0d642cf08671920/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:34.268732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b592fcb57cca47d488a8e2bada0aaca0, user_id=d1e1b7fc3e2d4943a0d642cf08671920, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:34.271514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:34.282273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1323/2648] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:34 2022] PUT /identity/v3/projects/b592fcb57cca47d488a8e2bada0aaca0/users/d1e1b7fc3e2d4943a0d642cf08671920/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:34.293099 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:34.293480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:34.293664 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:34.322528 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] MFA Rules not processed for user `d1e1b7fc3e2d4943a0d642cf08671920`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:34.323974 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:34.357654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:34.393354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1326/2649] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:34.404335 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:34.405985 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:34.450368 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:34.467085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51282fc-927e-4b3e-93f4-afe24d023f30 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:34.470762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:34.471493 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:34.471722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:34.472035 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:34.492277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:34.492277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:34.495266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1324/2650] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:34.716600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:34.726414 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3adb-2cb4-4b30-80e5-195345fb5e01 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:34.731484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:34.732139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:34.732416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:34.732744 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:34.793092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:34.794440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bddf6-7288-4041-a462-dc9522436b68 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:34.803814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1327/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:40.761263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:40.841834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57debb51-b8a1-424a-baf8-cddb8ae51fca service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:40.846716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:40.847350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:40.847650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:40.847949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] PATH_INFO: `/v3/users/8bf2051d3af647e69d2ce21a3ea4bb5b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:40.849078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf2051d3af647e69d2ce21a3ea4bb5b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:40.850992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:41.052021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf2051d3af647e69d2ce21a3ea4bb5b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:41.058886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf2051d3af647e69d2ce21a3ea4bb5b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:41.118055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf2051d3af647e69d2ce21a3ea4bb5b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:41.118685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf2051d3af647e69d2ce21a3ea4bb5b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:41.132032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf2051d3af647e69d2ce21a3ea4bb5b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:41.137984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1325/2652] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:40 2022] DELETE /identity/v3/users/8bf2051d3af647e69d2ce21a3ea4bb5b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:41.142716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:41.143234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:41.143234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:41.162051 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:41.163256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:41.222590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1328/2653] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:41.234518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:41.236180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:41.296400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0c515-3d6e-4868-8de5-e8a6db5207c7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:41.300144 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:41.300778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:41.301055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:41.301319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:41.311038 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:41.312689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:41.322374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1326/2654] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:41.793574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:41.794979 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:41.809169 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd394b4-ce81-4be2-9f68-a2f51e1a7cce None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:41.814040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:41.814670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:41.814948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:41.815733 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] PATH_INFO: `/v3/projects/ff167259c7e54d3eb2f910b015119961` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:41.823250 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff167259c7e54d3eb2f910b015119961)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:41.825235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:41.998510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff167259c7e54d3eb2f910b015119961', 'request_id': 'req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.005972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff167259c7e54d3eb2f910b015119961', 'request_id': 'req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.084124 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff167259c7e54d3eb2f910b015119961', 'request_id': 'req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.086572 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:42.096603 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] The token cache is being invalidate because project ff167259c7e54d3eb2f910b015119961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:42.096892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.097531 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.098992 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1329/2655] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:41 2022] DELETE /identity/v3/projects/ff167259c7e54d3eb2f910b015119961 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:42.103182 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:42.108610 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:42.114370 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d1b0-0bc8-40bf-84a9-c57d0582f88c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:42.176361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:42.176997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:42.177276 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:42.177544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] PATH_INFO: `/v3/users/d1e1b7fc3e2d4943a0d642cf08671920` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:42.178661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e1b7fc3e2d4943a0d642cf08671920)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:42.180617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:42.316436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e1b7fc3e2d4943a0d642cf08671920'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.323308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e1b7fc3e2d4943a0d642cf08671920'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.397490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e1b7fc3e2d4943a0d642cf08671920'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.398137 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e1b7fc3e2d4943a0d642cf08671920'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.412107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f5b2224-5450-4278-87ff-d33a11cec485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e1b7fc3e2d4943a0d642cf08671920'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:42.417992 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1327/2656] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:42 2022] DELETE /identity/v3/users/d1e1b7fc3e2d4943a0d642cf08671920 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:42.847253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:42.848935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:42.864582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82fe78-b378-4229-b523-9a6bd9aa7cb9 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:42.925361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:42.925988 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:42.926260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:42.926523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] PATH_INFO: `/v3/projects/b592fcb57cca47d488a8e2bada0aaca0` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:42.927635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=b592fcb57cca47d488a8e2bada0aaca0)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:42.929681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.079480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b592fcb57cca47d488a8e2bada0aaca0', 'request_id': 'req-9a676381-1592-4699-b67e-5ba9b39d8dde'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:43.085771 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b592fcb57cca47d488a8e2bada0aaca0', 'request_id': 'req-9a676381-1592-4699-b67e-5ba9b39d8dde'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:43.141313 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b592fcb57cca47d488a8e2bada0aaca0', 'request_id': 'req-9a676381-1592-4699-b67e-5ba9b39d8dde'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:43.152319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] The token cache is being invalidate because project b592fcb57cca47d488a8e2bada0aaca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:43.159549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:43.159549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-9a676381-1592-4699-b67e-5ba9b39d8dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:43.159549 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1330/2657] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:42 2022] DELETE /identity/v3/projects/b592fcb57cca47d488a8e2bada0aaca0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:43.160277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d785dc-10ce-4640-8237-803750af48ce None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.160900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d785dc-10ce-4640-8237-803750af48ce None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.160900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d785dc-10ce-4640-8237-803750af48ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.180928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-49d785dc-10ce-4640-8237-803750af48ce None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:43.182129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-49d785dc-10ce-4640-8237-803750af48ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:43.244293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1328/2658] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:43.254212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.254495 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.254914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.276909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:43.278109 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:43.289379 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1331/2659] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:43.293676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d785dc-10ce-4640-8237-803750af48ce None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.303809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d785dc-10ce-4640-8237-803750af48ce None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.308472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.309077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.309352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.309624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.310261 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:31:43.310558 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.313271 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.325285 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1329/2660] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:31:43.330515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.341040 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175e87-d4bf-4dc9-bc3c-39fcb868c7b3 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.346688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.347285 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.347557 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.347854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.348467 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.350346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.440274 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1332/2661] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:43.444629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.456345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d80c-c492-4091-ac7a-360b3bee43aa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.461098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:43.516416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.517021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.517290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.517556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.518207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.520165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.628069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1330/2662] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:43.632251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.643294 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b7455-2476-4e25-b444-9d2cda541d6b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.647869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.648486 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.648784 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.649048 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.649683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.651262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.662028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1333/2663] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:43.666252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.676837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e37ce-d1f8-4f65-a01d-daa12532810a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.681516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.682169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.682443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.682710 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.683383 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.684995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda85812-f610-47ce-927f-0013fa04de5a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.696577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1331/2664] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:43.700762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.711615 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35550d72-0f65-41d2-9259-fee18c9f8290 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.716144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.716789 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.717069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.717330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] PATH_INFO: `/v3/projects/d999b99162a840789a4f0bb35bdd20f9/users/406663fd6edd4e05aed4e3298cd80242/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.732162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d999b99162a840789a4f0bb35bdd20f9, user_id=406663fd6edd4e05aed4e3298cd80242, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:43.734801 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:43.809693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1334/2665] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:43 2022] PUT /identity/v3/projects/d999b99162a840789a4f0bb35bdd20f9/users/406663fd6edd4e05aed4e3298cd80242/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:43.820552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.821185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.821185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:43.848803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] MFA Rules not processed for user `406663fd6edd4e05aed4e3298cd80242`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:43.850013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:43.919741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1332/2666] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:43.924873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:43.946117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:43.991743 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb33af-6450-4d72-8058-03fe3849d74b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:43.996714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:43.997847 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:43.998363 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:43.998683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.000464 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.002447 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.090590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1335/2667] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:43 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:44.094944 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.105750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b630b-b31c-440b-a1af-78e9a1bd5e1f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.162960 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.163696 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.163847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.164110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.164732 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.166634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.289774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1333/2668] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:44 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:44.293849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.338110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980c0d-cc75-4239-8f2e-2b972cdeaa0b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.338110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.338110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.338110 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.338579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.338579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.338579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.338579 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1336/2669] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:44.341158 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.352366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2f201-39f6-4c24-a879-c548ac6a4d03 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.357177 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.357837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.358113 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.359009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.359785 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.361476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d6d02-2475-4e6a-8e5c-40cc1179f6bb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.362945 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:44.372553 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1334/2670] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:44.386966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.397753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dab2b-c704-49d4-8eab-93771037c8e4 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.403349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.404054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.404327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.404597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] PATH_INFO: `/v3/projects/1d78f4783bde4a1d9aeda15a58c67176/users/4b1318871da546d881647dbb5055b132/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.421491 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d78f4783bde4a1d9aeda15a58c67176, user_id=4b1318871da546d881647dbb5055b132, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.424268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.537428 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1337/2671] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:44 2022] PUT /identity/v3/projects/1d78f4783bde4a1d9aeda15a58c67176/users/4b1318871da546d881647dbb5055b132/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:44.548621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.548811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.549068 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.586374 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] MFA Rules not processed for user `4b1318871da546d881647dbb5055b132`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:44.587594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:44.657981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1335/2672] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:31:44.662551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.728944 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58b83-179c-4f76-8f1c-9266dc6e550b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.733976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.734592 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.734869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.735137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.735794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.737713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.817396 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1338/2673] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:44 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:44.821416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.833191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19b54-a458-4514-971f-d38c3bee8a65 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:44.890440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:44.891141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:44.891565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:44.891698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:44.892405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:44.894330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:44.981319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1336/2674] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:44 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:31:44.985367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:44.996975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eb6d4-c37f-4299-a935-4bcd083dfddb admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:45.003026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:45.003630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.003942 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.004214 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.004856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:45.006462 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:45.018360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1339/2675] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:45.022797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:45.034040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060445d7-955c-44e3-9c7a-426a7139e4fa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:45.038682 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:45.041212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.041212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.041212 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] PATH_INFO: `/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992/users/89915a9d63164957b72642640d79b2ea/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.057758 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bba4e7ceb93444c8c47ea1b1924d992, user_id=89915a9d63164957b72642640d79b2ea, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:45.060459 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:45.152870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1337/2676] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:45 2022] PUT /identity/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992/users/89915a9d63164957b72642640d79b2ea/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:45.158161 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:45.169945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024649c-9d77-4d14-88dd-fbbcdfc7c55f admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:45.211796 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:45.229194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:45.229817 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.230093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.230409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.231090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:45.232742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb04114-07a7-4dfb-aaa0-fad66791b0f6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:45.244152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1340/2677] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:31:45.248502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:45.259929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74c39-2df6-42be-8556-6d12b99bcc95 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:45.264720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:45.265393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.265666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.265933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] PATH_INFO: `/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992/users/89915a9d63164957b72642640d79b2ea/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.267854 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bba4e7ceb93444c8c47ea1b1924d992, user_id=89915a9d63164957b72642640d79b2ea, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:45.270482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:45.281681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1338/2678] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:45 2022] PUT /identity/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992/users/89915a9d63164957b72642640d79b2ea/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:45.297417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.297700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.297973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.326824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] MFA Rules not processed for user `89915a9d63164957b72642640d79b2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:45.329702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:45.398506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1341/2679] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:45.410699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:45.412456 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:45.455250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:45.471238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f80bdd-2fb9-40a2-abab-4a9c84e22332 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:45.474848 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:45.475451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:45.475725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:45.476028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:45.537391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:45.538838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:45.547947 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1339/2680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:47.510762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:47.512158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:47.524452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09026f1d-6b6b-4fce-b90a-54d891736475 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:47.527966 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:47.528565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:47.528840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:47.529113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:47.588433 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:47.589862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:47.599373 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1342/2681] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:49.200464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:49.209976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00cdfe-f5dd-44c3-8b77-635e3359d3a8 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:49.213592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:49.214196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:49.214469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:49.214742 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:49.227310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:49.228780 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd5796-699a-40e3-aa06-1e8b5cc8b04d service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:49.238971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1340/2682] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:53.990993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:54.057480 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaf3ea-0ddc-4b50-969e-b4f8c23bfab4 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:54.062149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:54.062776 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:54.063052 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:54.063311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] PATH_INFO: `/v3/users/406663fd6edd4e05aed4e3298cd80242` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:54.064697 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=406663fd6edd4e05aed4e3298cd80242)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:54.066846 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:54.069436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:54.268347 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406663fd6edd4e05aed4e3298cd80242'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:54.340785 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406663fd6edd4e05aed4e3298cd80242'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:54.354687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406663fd6edd4e05aed4e3298cd80242'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:54.355471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406663fd6edd4e05aed4e3298cd80242'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:54.356084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406663fd6edd4e05aed4e3298cd80242'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:54.369835 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1343/2683] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:53 2022] DELETE /identity/v3/users/406663fd6edd4e05aed4e3298cd80242 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:54.374970 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:54.375453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:54.375554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:54.396192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:54.397418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:54.462747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1341/2684] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:54.473368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:54.475586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:54.546365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ffce3-290c-4ca8-8707-f90524fa43ee admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:54.553290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:54.553908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:54.554182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:54.554444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:54.564227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:54.565676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:54.578364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1344/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:55.051904 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:55.053328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:55.065599 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800f105-bde0-4780-bcf3-d1ee6ba24deb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:55.071490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:55.072506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:55.079720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:55.079720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] PATH_INFO: `/v3/projects/d999b99162a840789a4f0bb35bdd20f9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:55.079720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d999b99162a840789a4f0bb35bdd20f9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:55.079720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:55.205879 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd999b99162a840789a4f0bb35bdd20f9', 'request_id': 'req-5025153e-4791-485f-b5f9-73c2fdebfae9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.213681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd999b99162a840789a4f0bb35bdd20f9', 'request_id': 'req-5025153e-4791-485f-b5f9-73c2fdebfae9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.277951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd999b99162a840789a4f0bb35bdd20f9', 'request_id': 'req-5025153e-4791-485f-b5f9-73c2fdebfae9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.291006 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] The token cache is being invalidate because project d999b99162a840789a4f0bb35bdd20f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:55.291311 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.291995 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.293541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1342/2686] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:55 2022] DELETE /identity/v3/projects/d999b99162a840789a4f0bb35bdd20f9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:31:55.298322 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:55.312449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa5a13-63ac-4358-8957-87241d72ee7d service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:55.377959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:55.378591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:55.378868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:55.379703 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] PATH_INFO: `/v3/users/4b1318871da546d881647dbb5055b132` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:55.381261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1318871da546d881647dbb5055b132)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:55.383272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:55.502305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:55.584316 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1318871da546d881647dbb5055b132'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.626422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1318871da546d881647dbb5055b132'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.642121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1318871da546d881647dbb5055b132'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.642868 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1318871da546d881647dbb5055b132'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.643880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1318871da546d881647dbb5055b132'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:55.657389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1345/2687] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:55 2022] DELETE /identity/v3/users/4b1318871da546d881647dbb5055b132 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:56.050881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:56.052648 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:56.062912 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:56.068090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025153e-4791-485f-b5f9-73c2fdebfae9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:56.133090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:56.133788 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:56.134164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:56.134357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] PATH_INFO: `/v3/projects/1d78f4783bde4a1d9aeda15a58c67176` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:56.135515 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d78f4783bde4a1d9aeda15a58c67176)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:56.137474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:56.253484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d78f4783bde4a1d9aeda15a58c67176', 'request_id': 'req-580e8f43-3f53-443c-941e-b4a7dedfa8aa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.260901 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d78f4783bde4a1d9aeda15a58c67176', 'request_id': 'req-580e8f43-3f53-443c-941e-b4a7dedfa8aa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.318477 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d78f4783bde4a1d9aeda15a58c67176', 'request_id': 'req-580e8f43-3f53-443c-941e-b4a7dedfa8aa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.330075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] The token cache is being invalidate because project 1d78f4783bde4a1d9aeda15a58c67176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:56.330360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.331021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.333307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1343/2688] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:56 2022] DELETE /identity/v3/projects/1d78f4783bde4a1d9aeda15a58c67176 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:31:56.339293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:56.341178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:56.354989 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c29a0-0a87-45b4-8d37-124ae3cb49b3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:56.422026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:56.422687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:56.423025 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:56.423293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] PATH_INFO: `/v3/users/89915a9d63164957b72642640d79b2ea` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:56.424435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89915a9d63164957b72642640d79b2ea)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:56.426901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:56.646078 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89915a9d63164957b72642640d79b2ea'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.735028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89915a9d63164957b72642640d79b2ea'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.750910 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89915a9d63164957b72642640d79b2ea'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.752422 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89915a9d63164957b72642640d79b2ea'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.753035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4c6b092b-f55d-40de-b547-57c6e7ac6936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89915a9d63164957b72642640d79b2ea'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:56.772630 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1346/2689] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:31:56 2022] DELETE /identity/v3/users/89915a9d63164957b72642640d79b2ea => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:57.244881 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:57.246578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:57.266084 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e8f43-3f53-443c-941e-b4a7dedfa8aa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:57.389774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:57.391034 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:57.391487 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:57.391962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] PATH_INFO: `/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:57.393318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bba4e7ceb93444c8c47ea1b1924d992)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:57.396377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:57.516434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:57.529304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bba4e7ceb93444c8c47ea1b1924d992', 'request_id': 'req-6cd37af3-ef91-4c43-9104-7f452d29137d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:57.537605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bba4e7ceb93444c8c47ea1b1924d992', 'request_id': 'req-6cd37af3-ef91-4c43-9104-7f452d29137d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:57.683902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bba4e7ceb93444c8c47ea1b1924d992', 'request_id': 'req-6cd37af3-ef91-4c43-9104-7f452d29137d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:57.699408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] The token cache is being invalidate because project 0bba4e7ceb93444c8c47ea1b1924d992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:31:57.700079 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:57.701638 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6cd37af3-ef91-4c43-9104-7f452d29137d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:31:57.703294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1344/2690] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:31:57 2022] DELETE /identity/v3/projects/0bba4e7ceb93444c8c47ea1b1924d992 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:57.708597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:57.709172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:57.709477 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:57.744411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:57.744411 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:57.761012 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:57.826238 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1347/2691] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:31:57.834438 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:57.834717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:57.834984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:57.872512 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:57.875545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:57.879185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:57.880686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:57.904324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1345/2692] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:31:57.906547 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:57.930646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116d035-63df-44b6-a0bd-b8356c953159 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:57.948621 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:57.949632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:57.953557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:57.953557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:57.953557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:31:57.953557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:57.959119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:57.974697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1346/2693] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:31:57.978825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:57.993041 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7efc2-88be-419c-8ffd-4024eb7dac26 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:57.994010 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af1fc3-f187-42e5-b432-c89209bcf6e4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:57.998847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:57.999314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.000086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.000684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.000987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:58.001705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.001995 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.002273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.002544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.004184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.008398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:58.037581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.039478 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.054183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1348/2694] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:31:58.156347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1347/2695] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:31:57 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:58.161182 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:58.178056 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bbfbf-1272-4315-b453-d5445afaf085 service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:58.361951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:58.364515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.364515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.364515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.364515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.366204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.491449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1349/2696] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:31:58 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:31:58.495836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:58.508514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186fb8-2e1b-48c5-8e2a-3add1712f8aa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:58.514244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:58.515215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.515554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.517364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.520930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.520930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.541347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1348/2697] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:31:58.544843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:58.564367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df6d4-7190-45f2-9fbb-28596e3be4b2 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:58.574904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:58.575913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.575913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.575913 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.577364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.580530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdee295-bb2d-42f8-b5ac-6b66c86f16ef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.595544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1350/2698] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:31:58.603363 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:58.618760 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a64d-cf67-40a1-964c-d1659357514d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:58.628207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:58.629066 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.630366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.630366 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] PATH_INFO: `/v3/projects/e89a3d059b2b4321b16fd68d921ddfcb/users/8c8bf9f97fd64ec8b1e4a2d72e583fab/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.660782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89a3d059b2b4321b16fd68d921ddfcb, user_id=8c8bf9f97fd64ec8b1e4a2d72e583fab, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:58.664756 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:58.742747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1349/2699] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:31:58 2022] PUT /identity/v3/projects/e89a3d059b2b4321b16fd68d921ddfcb/users/8c8bf9f97fd64ec8b1e4a2d72e583fab/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:31:58.753155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a8645-01b9-4989-bcb6-58d38f9a6fbe None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:58.753155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a8645-01b9-4989-bcb6-58d38f9a6fbe None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:58.753155 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a8645-01b9-4989-bcb6-58d38f9a6fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:58.780862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-186a8645-01b9-4989-bcb6-58d38f9a6fbe None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:31:58.781871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-186a8645-01b9-4989-bcb6-58d38f9a6fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:58.816255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:31:58.875645 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1351/2700] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:31:58.919301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:31:58.921215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:31:59.036308 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f642d-0ed3-4f79-a300-687b0347b970 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:31:59.041470 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:31:59.045795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:31:59.045795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:31:59.045795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:31:59.054406 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:31:59.056147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:31:59.070095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1350/2701] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:00.886945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:00.887611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:00.887611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:00.924035 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] MFA Rules not processed for user `8c8bf9f97fd64ec8b1e4a2d72e583fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:00.925349 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:01.021885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1352/2702] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:01.034913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:01.036900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:01.119449 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:01.123876 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62421e2d-4a81-4d90-b739-c51a472a69d1 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:01.132818 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:01.136472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:01.136472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:01.136472 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:01.146249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:01.147803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925657a-770b-47d1-83eb-afcb5eb8b2d0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:01.163393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1351/2703] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:32:03.100691 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:03.110838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb184c92-b8d8-4cc4-bcb5-a9dd31085189 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:03.116158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:03.116802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:03.117077 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:03.117342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:03.119219 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:03.132471 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:03.133914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:03.144517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1353/2704] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:04.014564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:04.015153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:04.015153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:04.076173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] MFA Rules not processed for user `8c8bf9f97fd64ec8b1e4a2d72e583fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:04.077765 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:04.085817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1352/2705] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:04.450370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:04.452033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:04.468673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79675-0e96-4e33-bb25-a59b4a4d8355 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:04.472674 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:04.473317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:04.473600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:04.473872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:04.478436 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:04.490742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:04.492223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:04.501701 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1354/2706] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:06.073226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:06.075025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:06.204635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107de82-8354-4e58-b16b-2f462ce3b93f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:06.212884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:06.213541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:06.213830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:06.214102 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:06.216082 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:06.244193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:06.245840 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:06.272786 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1353/2707] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:07.004700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:07.006901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:07.022177 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb40511-933b-4151-b8dc-07183b237b18 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:07.032188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:07.032188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:07.032188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:07.032188 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] PATH_INFO: `/v3/users/53d8816f0b3a4cb1a9da6dc11428b514` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:07.044598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d8816f0b3a4cb1a9da6dc11428b514)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:07.046532 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:07.217569 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d8816f0b3a4cb1a9da6dc11428b514'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.283121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d8816f0b3a4cb1a9da6dc11428b514'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.301220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d8816f0b3a4cb1a9da6dc11428b514'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.302019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d8816f0b3a4cb1a9da6dc11428b514'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.303309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-405d482a-6c20-435e-9e7c-fb652d23223f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d8816f0b3a4cb1a9da6dc11428b514'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.307216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:07.318346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1355/2708] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:07 2022] DELETE /identity/v3/users/53d8816f0b3a4cb1a9da6dc11428b514 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:07.703011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:07.719215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca74139-c11c-458d-be2a-bc413c70088f service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:07.787086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:07.787738 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:07.788069 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:07.788314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] PATH_INFO: `/v3/projects/d2e649efab714436a9ded73cc61e3186` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:07.800334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e649efab714436a9ded73cc61e3186)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:07.802357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:07.902683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e649efab714436a9ded73cc61e3186', 'request_id': 'req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.910415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e649efab714436a9ded73cc61e3186', 'request_id': 'req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.976324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e649efab714436a9ded73cc61e3186', 'request_id': 'req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.984036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:07.990045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] The token cache is being invalidate because project d2e649efab714436a9ded73cc61e3186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:07.990405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.994900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7e97f5bc-65c0-4290-b6a9-674696bd6d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:07.997283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1354/2709] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:07 2022] DELETE /identity/v3/projects/d2e649efab714436a9ded73cc61e3186 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:08.003122 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.003679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.004144 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.031843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:08.033185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:08.146001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1356/2710] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:08.156039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.156320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.156589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.176891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:08.178684 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:08.186630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1355/2711] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:08.191104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.201416 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf288-ab25-4aac-b6e4-cc5cbd288a3a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.206403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.207037 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.207314 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.207581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.208333 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:08.208695 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.210517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.227368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1357/2712] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:32:08.228680 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.238718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bc78d-c486-48b8-84ca-e59fb131c666 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.246341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.247337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.247864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.248330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.249701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.251933 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.359516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1356/2713] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:08 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:08.369884 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.381018 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d95d-1517-4d52-abcc-dd5bd77eb55c admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.456507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.457196 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.457542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.457880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.459242 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.461400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.546094 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1358/2714] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:08 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:08.550245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.560909 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55aa2f-35d2-42b0-b83d-9abe2dc7bddc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.566604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.567328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.567605 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.567924 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.568577 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.570245 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.585571 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1357/2715] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:08.587130 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.597298 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61688898-f6e8-4f58-bb72-53ac797fdcc6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.603276 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.603929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.604206 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.604473 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.605105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.606692 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959cd54-c417-49e8-82b0-37d4ec709bfb admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.617732 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1359/2716] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:32:08.621790 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.633713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142fdd6-ec8e-4d14-a6ad-9b1b98b9238a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.638398 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.641823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.641823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.641823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] PATH_INFO: `/v3/projects/42eec202a1714b4ba44bb53f00812b80/users/dfee697da16744169c61a7da1a997fbb/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.658740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42eec202a1714b4ba44bb53f00812b80, user_id=dfee697da16744169c61a7da1a997fbb, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.662624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.746503 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1358/2717] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:08 2022] PUT /identity/v3/projects/42eec202a1714b4ba44bb53f00812b80/users/dfee697da16744169c61a7da1a997fbb/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:08.758415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381a73-1e54-4b9e-9343-f41e2b55b0f8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.758694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381a73-1e54-4b9e-9343-f41e2b55b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.758967 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381a73-1e54-4b9e-9343-f41e2b55b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.786281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d4381a73-1e54-4b9e-9343-f41e2b55b0f8 None None] MFA Rules not processed for user `dfee697da16744169c61a7da1a997fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:08.788204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d4381a73-1e54-4b9e-9343-f41e2b55b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:08.832104 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:08.852849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1360/2718] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:08.864541 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:08.866997 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:08.945667 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426973d-7e0f-4db7-b668-f6734aa97356 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:08.957341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:08.957341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:08.957341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:08.957341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:08.962338 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:08.963990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:08.973832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1359/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:09.352673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:09.353135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:09.353261 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:09.372799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:09.374225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:09.430289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1361/2720] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:32:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:09.571190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:09.571190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:09.642704 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c79c5-7271-4c9c-abbe-8e7dd97dba17 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:09.647949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:09.648552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:09.648836 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:09.649108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:09.657128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:09.658701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:09.667390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1360/2721] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:32:14.991809 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:14.993342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:15.075226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e23600-0f78-4690-b199-5d97a8dd6623 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:15.080420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:15.081128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:15.081558 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:15.081981 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:15.084820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:15.097419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:15.099712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013c34-3f30-4fe2-931e-781838d765c8 service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:15.110232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1362/2722] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:15.493598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:15.508181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:15.571895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ffee2-5d8e-4b3f-9a5f-6da3327e99f8 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:15.578984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:15.579624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:15.579927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:15.580196 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] PATH_INFO: `/v3/users/dfee697da16744169c61a7da1a997fbb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:15.581314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfee697da16744169c61a7da1a997fbb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:15.583596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:15.733583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfee697da16744169c61a7da1a997fbb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:15.744660 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfee697da16744169c61a7da1a997fbb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:15.814388 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfee697da16744169c61a7da1a997fbb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:15.815121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfee697da16744169c61a7da1a997fbb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:15.828441 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfee697da16744169c61a7da1a997fbb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:15.834616 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1361/2723] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:15 2022] DELETE /identity/v3/users/dfee697da16744169c61a7da1a997fbb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:15.839792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:15.840337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:15.843456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:15.861256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:15.866173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:15.927317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1363/2724] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:15.937222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:15.938726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:15.999064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023eba-ccbe-49fb-bbe4-d5665b8f1ddd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:16.003141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:16.003671 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.003979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.004251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.014393 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:16.015918 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffe307-6f45-4a45-bc12-b2885944ab22 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:16.026689 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1362/2725] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:16.458836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:16.460580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:16.475279 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f73d-5bb1-4e7a-be27-e98203ec088a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:16.480546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:16.481319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.482162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.482162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] PATH_INFO: `/v3/projects/42eec202a1714b4ba44bb53f00812b80` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.483071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42eec202a1714b4ba44bb53f00812b80)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:16.496301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:16.504653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:16.595050 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42eec202a1714b4ba44bb53f00812b80', 'request_id': 'req-dfe63334-668c-4468-9529-09107913b8b2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:16.604017 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42eec202a1714b4ba44bb53f00812b80', 'request_id': 'req-dfe63334-668c-4468-9529-09107913b8b2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:16.671986 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42eec202a1714b4ba44bb53f00812b80', 'request_id': 'req-dfe63334-668c-4468-9529-09107913b8b2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:16.684220 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] The token cache is being invalidate because project 42eec202a1714b4ba44bb53f00812b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:16.684689 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:16.685424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dfe63334-668c-4468-9529-09107913b8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:16.686963 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1364/2726] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:16 2022] DELETE /identity/v3/projects/42eec202a1714b4ba44bb53f00812b80 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:16.692796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.693589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.693589 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.715415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:16.716724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:16.743715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:16.796439 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1363/2727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:16.798388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.798879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.799230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.820786 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:16.822157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:16.830327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1365/2728] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:16.835434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:16.846023 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c84e3-1ee3-40eb-81a5-a2f0879ebe7b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:16.851521 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:16.852167 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.852444 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.852713 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.853352 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:16.853649 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:16.855418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:16.868387 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1364/2729] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 18:32:16.896229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:16.905751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a64bf-e34b-4ac6-936e-6aebada75e94 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:16.910482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:16.911729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:16.912036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:16.912568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:16.913404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:16.915319 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.068991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1366/2730] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:16 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:17.073612 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.086361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7b21d-b586-48b2-9183-402bb626a66e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.162418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.163164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.163442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.164584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.164769 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.166642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.260011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1365/2731] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:17 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:17.264573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.275688 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f92d5-edae-4209-88ef-616819d1bd93 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.281141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.281762 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.282033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.282297 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.283135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.284806 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.299073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1367/2732] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:17.300324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.312662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa8cf9-9b8e-41fd-836a-60c328087b3e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.317491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.318109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.318386 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.318655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.319294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.320953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540dfb-b5e9-4e96-9f9b-2208808cd1a8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.336430 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1366/2733] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:17.341079 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.352488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e378165-7bff-4c50-b20c-cf3706ec8d50 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.357860 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.358581 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.358895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.359168 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] PATH_INFO: `/v3/projects/b26d54cc355644d58e57d7865456a9ce/users/5fc4ffe5de194b598e1eea68a98fc89f/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.378173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26d54cc355644d58e57d7865456a9ce, user_id=5fc4ffe5de194b598e1eea68a98fc89f, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.381696 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.461836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1368/2734] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:17 2022] PUT /identity/v3/projects/b26d54cc355644d58e57d7865456a9ce/users/5fc4ffe5de194b598e1eea68a98fc89f/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:17.472284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.478204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.478204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.503569 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] MFA Rules not processed for user `5fc4ffe5de194b598e1eea68a98fc89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:17.506654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:17.586759 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1367/2735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:17.591324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.665324 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334246-6d95-4e0c-ad22-1029be2e4995 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.670256 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.670858 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.671137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.671409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.672065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.673976 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.748896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1369/2736] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:17 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:17.750770 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.762109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bb4b-ecf8-492f-a564-a569a3d534d3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.785434 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:17.827507 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.828166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.828443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.828716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.829336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.831259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.908990 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1368/2737] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:17 2022] POST /identity/v3/users => generated 302 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:17.910386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.921957 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c047a2f-bf49-45e2-8f7f-f04bf99e9e82 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.931213 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.931866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.932142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.932410 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.933054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.934654 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:17.947055 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1370/2738] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:17.951030 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:17.962952 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8335a-df2d-49e2-bf88-5c332b4fa073 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:17.968502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:17.969192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:17.969471 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:17.969744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] PATH_INFO: `/v3/projects/0f8c9ebdd091445c82103fa25efb487c/users/83ed9d14467c49f789dbd3fe2a67f83a/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:17.990850 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8c9ebdd091445c82103fa25efb487c, user_id=83ed9d14467c49f789dbd3fe2a67f83a, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:17.993635 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:18.060218 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1369/2739] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:17 2022] PUT /identity/v3/projects/0f8c9ebdd091445c82103fa25efb487c/users/83ed9d14467c49f789dbd3fe2a67f83a/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:18.061698 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:18.081090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283a49-588f-4ca0-8f98-d235062ab133 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:18.108284 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:18.165348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:18.165975 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:18.166257 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:18.166537 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:18.167211 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:18.169582 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b77d19-8980-49a1-ac7e-2fa58a7d9aa7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:18.185745 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1371/2740] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:18.186669 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:18.199380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0adf-ff66-4d97-9122-1c6fbdf9cfb1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:18.204536 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:18.205210 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:18.205489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:18.205963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] PATH_INFO: `/v3/projects/0f8c9ebdd091445c82103fa25efb487c/users/83ed9d14467c49f789dbd3fe2a67f83a/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:18.208679 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8c9ebdd091445c82103fa25efb487c, user_id=83ed9d14467c49f789dbd3fe2a67f83a, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:18.212020 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:18.235316 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1370/2741] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:18 2022] PUT /identity/v3/projects/0f8c9ebdd091445c82103fa25efb487c/users/83ed9d14467c49f789dbd3fe2a67f83a/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:18.238127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435764bb-f810-4708-8223-ed913d446091 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:18.238267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435764bb-f810-4708-8223-ed913d446091 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:18.238548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435764bb-f810-4708-8223-ed913d446091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:18.276971 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-435764bb-f810-4708-8223-ed913d446091 None None] MFA Rules not processed for user `83ed9d14467c49f789dbd3fe2a67f83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:18.282415 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-435764bb-f810-4708-8223-ed913d446091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:18.378734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1372/2742] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:18.389986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:18.392343 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:18.508984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ea59-0370-4806-9579-168161b9d1be admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:18.513913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:18.514540 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:18.514812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:18.515077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:18.533010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:18.534484 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:18.556083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1371/2743] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:18.604953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435764bb-f810-4708-8223-ed913d446091 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:18.607343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-435764bb-f810-4708-8223-ed913d446091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:18.621587 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435764bb-f810-4708-8223-ed913d446091 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:18.626753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:18.627452 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:18.627851 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:18.628184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:18.706444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:18.708533 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:18.724765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1373/2744] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:19.252207 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:19.253778 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:19.328602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5062bb-7758-4bde-b66e-d52c12185ce0 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:19.334761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:19.335415 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:19.335687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:19.336642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] PATH_INFO: `/v3/users/b90c73991c004f4c89a61932982307b8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:19.337148 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90c73991c004f4c89a61932982307b8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:19.339165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:19.368666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:19.553630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90c73991c004f4c89a61932982307b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:19.560347 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90c73991c004f4c89a61932982307b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:19.665719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90c73991c004f4c89a61932982307b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:19.666543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90c73991c004f4c89a61932982307b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:19.681076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90c73991c004f4c89a61932982307b8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:19.687046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1372/2745] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:19 2022] DELETE /identity/v3/users/b90c73991c004f4c89a61932982307b8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:19.982003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:19.994855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4997b4-72e7-4180-8d1c-861e90cf28b2 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:20.033208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:20.064748 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:20.065388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:20.065667 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:20.065937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] PATH_INFO: `/v3/projects/ddf2c4ae08864a11ab203550fcadf522` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:20.067258 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf2c4ae08864a11ab203550fcadf522)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:20.069637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:20.214903 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf2c4ae08864a11ab203550fcadf522', 'request_id': 'req-391be437-e017-4dde-827d-44fe2c81c95d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.226756 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf2c4ae08864a11ab203550fcadf522', 'request_id': 'req-391be437-e017-4dde-827d-44fe2c81c95d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.311421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf2c4ae08864a11ab203550fcadf522', 'request_id': 'req-391be437-e017-4dde-827d-44fe2c81c95d'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.322816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] The token cache is being invalidate because project ddf2c4ae08864a11ab203550fcadf522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:20.323101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.323726 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.325221 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1374/2746] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:19 2022] DELETE /identity/v3/projects/ddf2c4ae08864a11ab203550fcadf522 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:20.329401 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:20.330830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:20.344151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dba2f-09db-4443-aca3-8929e56943d2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:20.405394 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:20.406042 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:20.406310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:20.406574 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] PATH_INFO: `/v3/users/11ce46c5de0d4e508c45a6dcf9f993b6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:20.407724 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ce46c5de0d4e508c45a6dcf9f993b6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:20.409859 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:20.456816 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:20.459529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:20.543799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391be437-e017-4dde-827d-44fe2c81c95d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:20.553408 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:20.557764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:20.557764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:20.557764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:20.558278 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:20.576474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:20.578802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:20.581011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ce46c5de0d4e508c45a6dcf9f993b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.594623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1375/2747] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:20.609890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ce46c5de0d4e508c45a6dcf9f993b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.682882 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ce46c5de0d4e508c45a6dcf9f993b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.683567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ce46c5de0d4e508c45a6dcf9f993b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.699694 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ce46c5de0d4e508c45a6dcf9f993b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:20.706596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1373/2748] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:20 2022] DELETE /identity/v3/users/11ce46c5de0d4e508c45a6dcf9f993b6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:20.961742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:20.963872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:20.983687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1803-eb07-4880-92c0-b9b4342a768f service nova] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:21.047905 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:21.057335 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:21.057965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:21.058241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:21.058513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] PATH_INFO: `/v3/projects/caa54e44c24246b184cfe3dadc8725ba` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:21.059653 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa54e44c24246b184cfe3dadc8725ba)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:21.061590 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:21.164323 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa54e44c24246b184cfe3dadc8725ba', 'request_id': 'req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:21.170634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa54e44c24246b184cfe3dadc8725ba', 'request_id': 'req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:21.237594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa54e44c24246b184cfe3dadc8725ba', 'request_id': 'req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:21.250767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] The token cache is being invalidate because project caa54e44c24246b184cfe3dadc8725ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:21.251053 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:21.251713 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7b45eb8f-7945-4cc2-8136-2b66b1e2ce9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:21.253320 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1376/2749] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:20 2022] DELETE /identity/v3/projects/caa54e44c24246b184cfe3dadc8725ba => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:24.657618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:24.660516 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:24.673938 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47b09-5c3d-4e1b-b64d-f491013327d2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:24.688080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:24.733926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:24.734803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:24.734961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:24.735180 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] PATH_INFO: `/v3/users/5fc4ffe5de194b598e1eea68a98fc89f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:24.736356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc4ffe5de194b598e1eea68a98fc89f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:24.738364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:24.925183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc4ffe5de194b598e1eea68a98fc89f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:24.932360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc4ffe5de194b598e1eea68a98fc89f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.003520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc4ffe5de194b598e1eea68a98fc89f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.004356 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc4ffe5de194b598e1eea68a98fc89f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.020734 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc4ffe5de194b598e1eea68a98fc89f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.028160 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1374/2750] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:24 2022] DELETE /identity/v3/users/5fc4ffe5de194b598e1eea68a98fc89f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:25.032493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:25.032996 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:25.033127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:25.052924 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:25.054152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:25.115859 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1377/2751] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:25.126797 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:25.128364 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:25.188520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5208fc-1fda-406b-bf1f-a44e1e53b969 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:25.192851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:25.193457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:25.193723 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:25.193984 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:25.203200 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:25.204651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:25.214804 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1375/2752] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:25.701958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:25.703400 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:25.716961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccd9e0-6b9f-461a-98e6-4e10077f7719 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:25.727725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:25.728440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:25.728716 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:25.728985 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] PATH_INFO: `/v3/projects/b26d54cc355644d58e57d7865456a9ce` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:25.730197 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26d54cc355644d58e57d7865456a9ce)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:25.734128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:25.862520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26d54cc355644d58e57d7865456a9ce', 'request_id': 'req-a60547db-6e12-41f0-8497-f28379ae85aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.869585 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26d54cc355644d58e57d7865456a9ce', 'request_id': 'req-a60547db-6e12-41f0-8497-f28379ae85aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.922997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26d54cc355644d58e57d7865456a9ce', 'request_id': 'req-a60547db-6e12-41f0-8497-f28379ae85aa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.936068 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] The token cache is being invalidate because project b26d54cc355644d58e57d7865456a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:25.936352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.937029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:25.938519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1378/2753] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:25 2022] DELETE /identity/v3/projects/b26d54cc355644d58e57d7865456a9ce => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:25.942643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:25.952981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c6cf-8575-4850-a8e3-bb8073e9b659 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:25.996304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:26.016928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:26.017555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:26.017828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:26.018104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] PATH_INFO: `/v3/users/83ed9d14467c49f789dbd3fe2a67f83a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:26.019248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ed9d14467c49f789dbd3fe2a67f83a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:26.021887 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:26.186128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ed9d14467c49f789dbd3fe2a67f83a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.194535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ed9d14467c49f789dbd3fe2a67f83a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.243118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ed9d14467c49f789dbd3fe2a67f83a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.243739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ed9d14467c49f789dbd3fe2a67f83a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.258725 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b89d0427-a1cd-47e4-b93a-0bac7363eb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ed9d14467c49f789dbd3fe2a67f83a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.267184 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1376/2754] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:25 2022] DELETE /identity/v3/users/83ed9d14467c49f789dbd3fe2a67f83a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:26.667013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:26.668551 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:26.680224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:26.685003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60547db-6e12-41f0-8497-f28379ae85aa admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:26.764909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:26.765629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:26.765912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:26.766199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] PATH_INFO: `/v3/projects/0f8c9ebdd091445c82103fa25efb487c` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:26.768374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8c9ebdd091445c82103fa25efb487c)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:26.772229 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:26.885877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8c9ebdd091445c82103fa25efb487c', 'request_id': 'req-a9c791fd-730a-4b31-a599-139c9a8bbfd7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.896556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8c9ebdd091445c82103fa25efb487c', 'request_id': 'req-a9c791fd-730a-4b31-a599-139c9a8bbfd7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:26.997529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8c9ebdd091445c82103fa25efb487c', 'request_id': 'req-a9c791fd-730a-4b31-a599-139c9a8bbfd7'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:27.011391 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] The token cache is being invalidate because project 0f8c9ebdd091445c82103fa25efb487c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:27.011938 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:27.012670 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a9c791fd-730a-4b31-a599-139c9a8bbfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:27.015234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1379/2755] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:26 2022] DELETE /identity/v3/projects/0f8c9ebdd091445c82103fa25efb487c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:27.021588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.022105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.022105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.043046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:27.044303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:27.105147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1377/2756] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:27.114908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.115186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.115459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.140071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:27.141418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:27.151409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1380/2757] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:27.156039 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.168189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8c9fc-e62b-4e9a-8eec-b9ec45465e84 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.172951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.173562 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.173837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.174106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.174750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:27.175049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.177956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.194934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1378/2758] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:32:27.196036 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.205515 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad476-ba47-4f7f-ad85-e8c0102d7bef None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.210556 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.211162 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.211435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.211702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.212352 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.214374 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.329945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1381/2759] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:27.330185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.341043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafe4d-4622-4783-8e97-0ba337e4f860 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.390333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:27.403191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.403191 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.404611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.404611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.405112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.407088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.495345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1379/2760] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:27.499500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.511111 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6f06-db45-4f82-9220-0d51d3fc4213 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.515949 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.516626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.529445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.529445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.529445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.529445 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.530027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1382/2761] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:27.534319 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.545183 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a47d-66ca-40ca-9c77-a87ac7a705e6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.550827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.552009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.552288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.552619 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.553273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.554883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf53b-5e7a-48b9-93ed-e16c4c67f91c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.570303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1380/2762] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:27.571601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.582045 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96474297-9e40-407e-9d72-6a81d098c30e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.587263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.587951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.588230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.588548 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] PATH_INFO: `/v3/projects/2e83b33ab0e7464cbbf99ba25dcbc269/users/7fda03e49b8b4f3a915d35d2b636cfcf/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.603493 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e83b33ab0e7464cbbf99ba25dcbc269, user_id=7fda03e49b8b4f3a915d35d2b636cfcf, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.606312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:27.655798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1383/2763] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:27 2022] PUT /identity/v3/projects/2e83b33ab0e7464cbbf99ba25dcbc269/users/7fda03e49b8b4f3a915d35d2b636cfcf/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:27.668865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.669157 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.669432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.705651 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] MFA Rules not processed for user `7fda03e49b8b4f3a915d35d2b636cfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:27.706914 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:27.795532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1381/2764] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:27.801149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:27.848096 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:27.878141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762487-be47-4cb0-8279-5acec31d7322 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:27.891958 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:27.892580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:27.892874 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:27.893116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:27.893735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:27.896442 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.046388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1384/2765] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:27 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:28.050872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.062847 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80792f2-1cc7-494a-93b4-569761e98b7c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.142956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.143662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.143976 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.144247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.144994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.147170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.256333 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1382/2766] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:28 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:28.260564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.271768 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60d6a-8f24-4037-acb0-ea333a372f5b admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.276488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.277087 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.277364 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.277631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.278269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.280054 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.293382 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1385/2767] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:28.296643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.308535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff109a3e-313e-47c9-9fc0-c0df53827821 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.314332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.314986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.315260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.315528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] PATH_INFO: `/v3/projects/32f643e6ced6448e925530289c10deec/users/b1582bcea5f3435790c4d851226b1338/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.333578 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f643e6ced6448e925530289c10deec, user_id=b1582bcea5f3435790c4d851226b1338, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.336332 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.398125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1383/2768] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:28 2022] PUT /identity/v3/projects/32f643e6ced6448e925530289c10deec/users/b1582bcea5f3435790c4d851226b1338/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:28.402444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.413492 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1cc6-67fc-4c72-8dbc-7bfe45d85072 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.475255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.476180 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.476626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.477071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.478090 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.480799 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b230b-1011-4dde-be62-63e85a4413ef admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.494119 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1386/2769] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:28.498987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.512468 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97664041-7da3-4af5-8358-f4ab3ab628b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.517153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.517812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.518083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.518442 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] PATH_INFO: `/v3/projects/32f643e6ced6448e925530289c10deec/users/b1582bcea5f3435790c4d851226b1338/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.520548 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f643e6ced6448e925530289c10deec, user_id=b1582bcea5f3435790c4d851226b1338, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.523202 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.534579 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1384/2770] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:28 2022] PUT /identity/v3/projects/32f643e6ced6448e925530289c10deec/users/b1582bcea5f3435790c4d851226b1338/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:28.545552 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.548838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.548838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.574128 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] MFA Rules not processed for user `b1582bcea5f3435790c4d851226b1338`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:28.575337 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:28.641802 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1387/2771] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:28.653726 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.655249 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:28.665819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:28.719535 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c084e4-4e00-4c79-8014-a9b8455c291c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.724663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.725313 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.725587 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.725862 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.735337 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.736811 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cb480-4f36-4bc4-aee2-fc23c1a54ef6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:28.746750 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1385/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:28.896343 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:28.933616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:28.943681 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.944024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.944728 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.964381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] MFA Rules not processed for user `8c8bf9f97fd64ec8b1e4a2d72e583fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:28.965596 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:28.969649 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841be83-d3fb-442a-84f5-c420cad60ad9 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:28.976183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:28.976824 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:28.977147 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:28.977368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] PATH_INFO: `/v3/users/7fda03e49b8b4f3a915d35d2b636cfcf` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:28.978501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fda03e49b8b4f3a915d35d2b636cfcf)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:28.980530 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:29.025993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1386/2773] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:29.158423 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fda03e49b8b4f3a915d35d2b636cfcf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:29.243340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fda03e49b8b4f3a915d35d2b636cfcf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:29.257384 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fda03e49b8b4f3a915d35d2b636cfcf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:29.258192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fda03e49b8b4f3a915d35d2b636cfcf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:29.258795 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-17f1989b-bf1d-4e5e-b90a-c09cd30c3bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fda03e49b8b4f3a915d35d2b636cfcf'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:29.266884 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:29.268454 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:29.272568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1388/2774] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:28 2022] DELETE /identity/v3/users/7fda03e49b8b4f3a915d35d2b636cfcf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:29.276782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:29.277136 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:29.277409 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:29.296504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:29.297711 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:29.328131 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e847-636e-4f4c-b83b-e1dd546c3044 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:29.359805 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1389/2775] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:29.367844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:29.369230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:29.378132 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:29.378740 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:29.379013 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:29.379273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:29.381133 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:29.390687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:29.392161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:29.402722 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1387/2776] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:29.422928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:29.429192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792cc1-959d-4e48-a54e-f9a9d5d64a09 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:29.433189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:29.436523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:29.436523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:29.436523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:29.443608 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:29.445071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:29.454723 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1390/2777] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:32:29.976391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:29.978428 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:30.002221 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f4ebb-2ba3-47f2-be79-55a21f4cdc95 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:30.011223 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:30.011928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:30.012208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:30.012476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] PATH_INFO: `/v3/projects/2e83b33ab0e7464cbbf99ba25dcbc269` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:30.013834 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e83b33ab0e7464cbbf99ba25dcbc269)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:30.015825 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:30.025287 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:30.164324 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e83b33ab0e7464cbbf99ba25dcbc269', 'request_id': 'req-94431c75-370e-495c-9bfa-20d32c2c79fe'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.170532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e83b33ab0e7464cbbf99ba25dcbc269', 'request_id': 'req-94431c75-370e-495c-9bfa-20d32c2c79fe'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.254615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e83b33ab0e7464cbbf99ba25dcbc269', 'request_id': 'req-94431c75-370e-495c-9bfa-20d32c2c79fe'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.265746 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] The token cache is being invalidate because project 2e83b33ab0e7464cbbf99ba25dcbc269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:30.266032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.266655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.268168 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1388/2778] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:29 2022] DELETE /identity/v3/projects/2e83b33ab0e7464cbbf99ba25dcbc269 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:30.272693 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:30.282367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f861ce-18cd-447b-9516-1c928b827d99 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:30.344137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:30.344517 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:30.344880 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:30.345029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] PATH_INFO: `/v3/users/b1582bcea5f3435790c4d851226b1338` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:30.346152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1582bcea5f3435790c4d851226b1338)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:30.348682 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:30.526404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1582bcea5f3435790c4d851226b1338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.574575 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1582bcea5f3435790c4d851226b1338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.588752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1582bcea5f3435790c4d851226b1338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.589468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1582bcea5f3435790c4d851226b1338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.590046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-ad1d8230-656b-476f-a8cd-fe4e16b951a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1582bcea5f3435790c4d851226b1338'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:30.603093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1391/2779] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:30 2022] DELETE /identity/v3/users/b1582bcea5f3435790c4d851226b1338 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:31.084568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.086010 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:31.111238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94431c75-370e-495c-9bfa-20d32c2c79fe admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.172152 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.172861 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.173054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.173322 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] PATH_INFO: `/v3/projects/32f643e6ced6448e925530289c10deec` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.174485 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f643e6ced6448e925530289c10deec)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.176979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.261987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f643e6ced6448e925530289c10deec', 'request_id': 'req-4cec939e-6822-4b03-9abd-8be97be12cc8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:31.268514 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f643e6ced6448e925530289c10deec', 'request_id': 'req-4cec939e-6822-4b03-9abd-8be97be12cc8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:31.334288 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f643e6ced6448e925530289c10deec', 'request_id': 'req-4cec939e-6822-4b03-9abd-8be97be12cc8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:31.345533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] The token cache is being invalidate because project 32f643e6ced6448e925530289c10deec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:31.345906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:31.346564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-4cec939e-6822-4b03-9abd-8be97be12cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:31.348592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1389/2780] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:31 2022] DELETE /identity/v3/projects/32f643e6ced6448e925530289c10deec => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:31.353521 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.354073 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.354189 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.374245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:31.375712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:31.436244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1392/2781] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:31.444360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.444636 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.444907 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.465194 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:31.466414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:31.475598 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1390/2782] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:31.480217 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.491063 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5e62-51e3-4dc5-8e6b-e1cb732e3496 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.496020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.496636 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.496914 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.497185 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.497885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:31.498186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.500164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.502934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:31.512794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1393/2783] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:32:31.517284 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.527007 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336bf44-86e9-46e5-a1cc-a2253ffa0955 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.531644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.532273 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.532544 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.532810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.533432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.535325 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.626505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:31.634025 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1391/2784] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:31 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:31.642507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.650241 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca29b7e-a997-437a-9e8f-0aae3ea3a6dc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.710468 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.711081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.711355 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.711624 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.712272 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.714174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.809663 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1394/2785] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:31 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:31.814375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.825747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31412-7be2-4504-be9c-b41a2e4ba986 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.830496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.831101 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.831384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.831654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.832391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.833991 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.843963 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1392/2786] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:31.848071 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.858330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e99b-4400-46bf-82a7-f0b1d8f1dbee admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.864807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.865523 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.865916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.866227 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.867159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.868906 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b90759-9470-454a-8932-a8e8572d927c admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:31.884312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1395/2787] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:31.888645 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:31.899492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ff61-26a5-4f0b-80fa-c02265d51b6b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:31.905260 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:31.905925 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:31.906204 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:31.906475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] PATH_INFO: `/v3/projects/61f1a2d4357848fd98cb5560d536a669/users/9dc12a2c58f2438cae1bda57eb04c1c2/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:31.922086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f1a2d4357848fd98cb5560d536a669, user_id=9dc12a2c58f2438cae1bda57eb04c1c2, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:31.924703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.014905 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1393/2788] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:31 2022] PUT /identity/v3/projects/61f1a2d4357848fd98cb5560d536a669/users/9dc12a2c58f2438cae1bda57eb04c1c2/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:32.027135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.027413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.027699 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.057498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] MFA Rules not processed for user `9dc12a2c58f2438cae1bda57eb04c1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:32.058931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:32.154568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1396/2789] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:32.159277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.230699 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3159e-1da0-4de4-980f-1f6f29158837 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.251864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.251864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.251864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.251864 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.252233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.252632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.365502 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1394/2790] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:32 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:32.369660 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.382620 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8949a-ab81-47a7-be4f-c6926364f310 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.448526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.449450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.449730 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.450002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.450635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.452597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.464089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:32.558712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1397/2791] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:32 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:32:32.562511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.573543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e8c4-809d-4da4-8750-ba3f69e6b38e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.578122 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.578719 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.578987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.579282 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.579951 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.581537 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.592827 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1395/2792] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:32.597038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.608001 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293ba2a-9c20-46cb-8959-ab855a742493 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.612619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.613268 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.613535 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.614098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] PATH_INFO: `/v3/projects/a269f79402944c48901120bdf4ce982e/users/3ffaf0ca62d6431b858c886631a15532/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.632159 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a269f79402944c48901120bdf4ce982e, user_id=3ffaf0ca62d6431b858c886631a15532, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.635683 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.712262 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1398/2793] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:32 2022] PUT /identity/v3/projects/a269f79402944c48901120bdf4ce982e/users/3ffaf0ca62d6431b858c886631a15532/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:32.716794 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.728224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9375a-8f14-4966-98ec-11e6ccb156ee admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.786585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.787279 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.787557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.787858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.788496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.790104 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420edc-de9b-4bf4-a1c2-695af9d4373b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.799883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1396/2794] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:32.804232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.819578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f229-884a-434d-b3b8-fd6fab45c5cc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:32.825081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:32.825735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.826080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.826351 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] PATH_INFO: `/v3/projects/a269f79402944c48901120bdf4ce982e/users/3ffaf0ca62d6431b858c886631a15532/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.828341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a269f79402944c48901120bdf4ce982e, user_id=3ffaf0ca62d6431b858c886631a15532, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:32.830993 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:32.842520 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1399/2795] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:32 2022] PUT /identity/v3/projects/a269f79402944c48901120bdf4ce982e/users/3ffaf0ca62d6431b858c886631a15532/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:32.852875 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:32.853162 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:32.854118 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:32.883269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] MFA Rules not processed for user `3ffaf0ca62d6431b858c886631a15532`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:32.884522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:32.906690 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:32.958630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1397/2796] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:32.970651 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:32.972451 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:33.034940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3abc0-f738-4e8a-ab59-b5090ad569d6 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:33.038646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:33.039244 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:33.039513 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:33.039854 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:33.049199 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:33.050619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:33.060775 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1400/2797] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:33.352634 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:33.363359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e1a4-42af-4103-bd47-7ad60d6c25fd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:33.367240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:33.367883 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:33.368150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:33.368417 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:33.440270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:33.441774 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1ef72-1c71-4d1a-9060-13da098a27f4 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:33.451418 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1398/2798] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:40.896714 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:40.966810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcd894-f526-4eb8-9008-8d2d8ad8b62a service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:40.971393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:40.972062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:40.972392 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:40.972679 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] PATH_INFO: `/v3/users/9dc12a2c58f2438cae1bda57eb04c1c2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:40.973804 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc12a2c58f2438cae1bda57eb04c1c2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:40.975886 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:41.170961 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc12a2c58f2438cae1bda57eb04c1c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:41.259580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc12a2c58f2438cae1bda57eb04c1c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:41.266106 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:41.274332 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc12a2c58f2438cae1bda57eb04c1c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:41.274946 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc12a2c58f2438cae1bda57eb04c1c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:41.280255 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc12a2c58f2438cae1bda57eb04c1c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:41.288751 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1401/2799] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:40 2022] DELETE /identity/v3/users/9dc12a2c58f2438cae1bda57eb04c1c2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:41.293346 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:41.293892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:41.293892 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:41.314972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:41.314972 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:41.377235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1399/2800] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:41.387529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:41.388990 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:41.454841 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebbb9f-c076-453c-9ab8-f74d49f7775e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:41.461386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:41.461998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:41.462273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:41.462541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:41.472120 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:41.473562 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:41.483831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1402/2801] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:42.222019 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:42.223568 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:42.236762 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a816a-43bb-4f6b-98fb-1e6b88eb0c1d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:42.244812 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:42.245474 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:42.245927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:42.246432 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] PATH_INFO: `/v3/projects/61f1a2d4357848fd98cb5560d536a669` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:42.248024 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f1a2d4357848fd98cb5560d536a669)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:42.250355 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:42.379009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f1a2d4357848fd98cb5560d536a669', 'request_id': 'req-aa525361-c4e2-48c3-8b05-1dfa89fce161'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.382032 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:42.386889 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f1a2d4357848fd98cb5560d536a669', 'request_id': 'req-aa525361-c4e2-48c3-8b05-1dfa89fce161'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.460556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f1a2d4357848fd98cb5560d536a669', 'request_id': 'req-aa525361-c4e2-48c3-8b05-1dfa89fce161'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.472390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] The token cache is being invalidate because project 61f1a2d4357848fd98cb5560d536a669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:42.472652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.473251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.475718 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1400/2802] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:42 2022] DELETE /identity/v3/projects/61f1a2d4357848fd98cb5560d536a669 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:42.480089 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:42.490309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cbbdc-8206-4bad-99c9-c6ce9ad696a4 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:42.555965 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:42.556605 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:42.556881 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:42.557149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] PATH_INFO: `/v3/users/3ffaf0ca62d6431b858c886631a15532` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:42.558329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffaf0ca62d6431b858c886631a15532)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:42.560370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:42.727312 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffaf0ca62d6431b858c886631a15532'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.819720 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffaf0ca62d6431b858c886631a15532'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.833453 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffaf0ca62d6431b858c886631a15532'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.834092 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffaf0ca62d6431b858c886631a15532'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.836181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1e14b854-3e56-4b63-9816-4dd3375ddb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffaf0ca62d6431b858c886631a15532'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:42.846371 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:42.851862 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1403/2803] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:42 2022] DELETE /identity/v3/users/3ffaf0ca62d6431b858c886631a15532 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:43.270644 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:43.272040 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:43.287480 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa525361-c4e2-48c3-8b05-1dfa89fce161 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:43.356226 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:43.357129 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.357481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.357902 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] PATH_INFO: `/v3/projects/a269f79402944c48901120bdf4ce982e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.359048 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a269f79402944c48901120bdf4ce982e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:43.361049 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:43.467307 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a269f79402944c48901120bdf4ce982e', 'request_id': 'req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:43.473564 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a269f79402944c48901120bdf4ce982e', 'request_id': 'req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:43.568833 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a269f79402944c48901120bdf4ce982e', 'request_id': 'req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:43.583792 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] The token cache is being invalidate because project a269f79402944c48901120bdf4ce982e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:43.584080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:43.584748 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e8b0a20c-084f-44aa-b82e-d5c689bc01a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:43.586242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1401/2804] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:43 2022] DELETE /identity/v3/projects/a269f79402944c48901120bdf4ce982e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:43.591117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.591811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.591811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.612033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:43.613232 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:43.676004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1404/2805] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:43.685119 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.685527 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.685942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.706056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:43.707248 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:43.716244 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1402/2806] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:43.720632 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:43.731928 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe05c8e-efe7-4ff0-8308-138dcfbb59c6 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:43.736742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:43.737339 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.737611 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.737873 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.738506 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:43.738798 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:43.740825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:43.753081 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1405/2807] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:32:43.757687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:43.767085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ca4e1-a2da-4bc3-92c6-9f50e6ea3523 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:43.772426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:43.773108 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.773359 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.773550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.774165 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:43.776095 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:43.896838 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1403/2808] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:43 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:43.900702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:43.910844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a56a39-1a1a-4889-a4a8-aa067c6b2701 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:43.967204 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:43.967838 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:43.968117 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:43.968386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:43.969011 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:43.971020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.078522 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1406/2809] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:43 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:44.082795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.094036 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1872b4-8771-4728-9b46-aad6594234d5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.098895 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.099666 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.099975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.100252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.100896 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.102512 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.113281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1404/2810] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:44.117353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.127997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44cad-c3d9-46a0-8cbb-bbf03fe0713d admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.133830 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.134457 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.134738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.135009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.135648 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.137330 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d5613-3176-48ad-baf6-6b168b10ba14 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.149541 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1407/2811] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:44.153584 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.163844 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c2563-2cc3-44ab-b740-a6b767cfe611 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.171357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.172057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.172334 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.174254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] PATH_INFO: `/v3/projects/ac875a7433a0495c81e71cf73a7f7ac7/users/1bdd50196fc14d4c8760b80e5c78bf12/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.193618 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac875a7433a0495c81e71cf73a7f7ac7, user_id=1bdd50196fc14d4c8760b80e5c78bf12, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.197077 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.273258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1405/2812] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:44 2022] PUT /identity/v3/projects/ac875a7433a0495c81e71cf73a7f7ac7/users/1bdd50196fc14d4c8760b80e5c78bf12/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:44.341266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.341547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.341814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.372849 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] MFA Rules not processed for user `1bdd50196fc14d4c8760b80e5c78bf12`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:44.374167 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:44.431207 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:44.439935 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1408/2813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:44.445408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.454602 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:44.514189 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8129c9-0b9e-47c6-8536-0f1b6830f4d6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.519358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.522252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.522252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.522252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.522252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.523800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.640663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1406/2814] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:44 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:44.645039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.659016 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38687b13-ede9-440f-97b8-71f09e8eafd7 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.725305 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.726049 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.726328 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.726597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.727223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.729186 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.843354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1409/2815] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:44 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:44.847583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.858443 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa7be8-a45d-4535-b065-9ee37f9ab7a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.863235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.863885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.864215 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.864533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.865232 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.866849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.880606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1407/2816] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:44.885174 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.895403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba8161-8396-477b-8106-5768858cd692 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.900915 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.901516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.903148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.903148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.903148 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.904354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937149a-8e5e-4ff7-8a5f-aff483e0e2d1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:44.915656 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1410/2817] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:32:44.919873 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:44.932399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a47abd-821c-4a15-ab32-70018af37354 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:44.938266 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:44.938934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:44.939214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:44.939489 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] PATH_INFO: `/v3/projects/39fc9c155c5c41ffbb89427048cf748d/users/4c645c645f164319bdcff7cc11989f45/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:44.958891 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fc9c155c5c41ffbb89427048cf748d, user_id=4c645c645f164319bdcff7cc11989f45, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:44.961606 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.083045 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1408/2818] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:44 2022] PUT /identity/v3/projects/39fc9c155c5c41ffbb89427048cf748d/users/4c645c645f164319bdcff7cc11989f45/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:45.095619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802c86-486a-41a9-924d-7336db11be1a None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.095927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802c86-486a-41a9-924d-7336db11be1a None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.096201 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802c86-486a-41a9-924d-7336db11be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.128311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-68802c86-486a-41a9-924d-7336db11be1a None None] MFA Rules not processed for user `4c645c645f164319bdcff7cc11989f45`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:45.129542 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-68802c86-486a-41a9-924d-7336db11be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:45.197879 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1411/2819] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:45.202628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.273624 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55907-c91f-49a1-a3be-e25d7af1bc33 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.278381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.279086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.279362 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.279632 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.280290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.282227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.380001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1409/2820] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:45 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:32:45.382084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802c86-486a-41a9-924d-7336db11be1a None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.395564 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802c86-486a-41a9-924d-7336db11be1a None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.457669 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.458483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.458767 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.459192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.459908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.461814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.472561 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:45.588388 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1412/2821] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:45 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:45.592469 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.603227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcbc41-c874-4d84-81cf-1e5124215fe4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.607981 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.608586 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.608858 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.609121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.609761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.611375 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.623975 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1410/2822] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:45.628560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.639484 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0bbd-d518-4c38-8ac1-c7b52e436025 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.644673 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.645340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.645997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.645997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] PATH_INFO: `/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb/users/45b695f8b0bf4637a8ca9bf668a1d445/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.663672 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b4d8e39cd641cb812ace6b5dec74bb, user_id=45b695f8b0bf4637a8ca9bf668a1d445, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.666425 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.734773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1413/2823] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:45 2022] PUT /identity/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb/users/45b695f8b0bf4637a8ca9bf668a1d445/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:45.739213 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.750451 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8648-c37e-4dcc-b1f6-1b35217e7a5c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.782392 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:45.810865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.811500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.811906 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.812098 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.812782 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.814761 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433d21e-5057-40b2-a0af-ca6ef7da196c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.827615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1411/2824] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:45.831931 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:45.843443 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c191-02fe-4746-876e-531702d02cf5 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:45.848178 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:45.848828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.849112 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.849420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] PATH_INFO: `/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb/users/45b695f8b0bf4637a8ca9bf668a1d445/roles/cfe0a4c208a6405884bcf1c12da0fa2d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.851367 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b4d8e39cd641cb812ace6b5dec74bb, user_id=45b695f8b0bf4637a8ca9bf668a1d445, role_id=cfe0a4c208a6405884bcf1c12da0fa2d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:45.854067 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:45.864888 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1414/2825] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:45 2022] PUT /identity/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb/users/45b695f8b0bf4637a8ca9bf668a1d445/roles/cfe0a4c208a6405884bcf1c12da0fa2d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:45.881492 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:45.881851 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:45.882106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:45.910496 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] MFA Rules not processed for user `45b695f8b0bf4637a8ca9bf668a1d445`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:45.911683 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:45.988414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1412/2826] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:46.000594 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:46.002295 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:46.062909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372728-3c9d-40f1-996e-79e39dd57607 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:46.066827 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:46.067550 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:46.068418 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:46.068972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:46.127788 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:46.129239 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:46.139304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1415/2827] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:48.131900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:48.133440 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:48.145823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17026-95d7-45ca-95f0-e831e08c23f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:48.149987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:48.150595 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:48.150866 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:48.151166 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:48.219161 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:48.221094 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebad73-f6f2-493a-bf72-13b5a581aff6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:48.234482 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1413/2828] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:49.662524 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:49.671398 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007741bc-34ac-4681-ace1-d102a3e51cb3 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:49.675093 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:49.675694 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:49.676002 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:49.676269 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:49.691163 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:49.692870 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:49.707833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1416/2829] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:50.009897 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:50.010716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:50.010716 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:50.029810 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:50.031231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:50.086360 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:50.098663 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1414/2830] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 18:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:50.111833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:50.113166 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:50.179507 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:50.194346 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65713-d34a-4bf0-bc4f-44b735e563d6 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:50.199273 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:50.199923 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:50.200291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:50.200450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:50.209013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:50.210729 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9071a-90d8-41c0-8fd4-dca61eab9dac service swift] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:50.220631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1417/2831] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 18:32:54.645059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:54.767080 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15992d4f-7602-4bce-a044-8717a5b3e4bd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:54.778054 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:54.781224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:54.781698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:54.782149 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] PATH_INFO: `/v3/users/1bdd50196fc14d4c8760b80e5c78bf12` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:54.784109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdd50196fc14d4c8760b80e5c78bf12)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:54.789926 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:55.057693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdd50196fc14d4c8760b80e5c78bf12'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:55.075254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdd50196fc14d4c8760b80e5c78bf12'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:55.145956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdd50196fc14d4c8760b80e5c78bf12'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:55.147815 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdd50196fc14d4c8760b80e5c78bf12'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:55.170211 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdd50196fc14d4c8760b80e5c78bf12'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:55.181310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1415/2832] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:54 2022] DELETE /identity/v3/users/1bdd50196fc14d4c8760b80e5c78bf12 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:55.186715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:55.187080 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:55.187731 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:55.222004 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:55.223236 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:55.309740 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1418/2833] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:55.322431 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:55.324173 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:55.418336 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab50aa2-ce8d-450d-bcdc-119f011243d4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:55.423771 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:55.424867 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:55.425309 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:55.425697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:55.439275 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:55.440942 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:55.451885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1416/2834] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:32:55.926889 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:55.931404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:55.976727 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abc56b-3295-42c0-9075-c9959b98b905 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:55.985376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:55.986387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:55.986752 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:55.987083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] PATH_INFO: `/v3/projects/ac875a7433a0495c81e71cf73a7f7ac7` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:55.988544 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac875a7433a0495c81e71cf73a7f7ac7)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:55.992091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:56.088527 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac875a7433a0495c81e71cf73a7f7ac7', 'request_id': 'req-db740128-98ea-423a-b097-9bf5046e6466'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.095850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac875a7433a0495c81e71cf73a7f7ac7', 'request_id': 'req-db740128-98ea-423a-b097-9bf5046e6466'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.174009 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac875a7433a0495c81e71cf73a7f7ac7', 'request_id': 'req-db740128-98ea-423a-b097-9bf5046e6466'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.190248 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] The token cache is being invalidate because project ac875a7433a0495c81e71cf73a7f7ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:56.192013 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.192712 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.195840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1419/2835] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:55 2022] DELETE /identity/v3/projects/ac875a7433a0495c81e71cf73a7f7ac7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:56.199826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:56.211890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76510009-c1ec-4feb-bfa7-384f4d347094 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:56.234530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:56.307475 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:56.308354 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:56.308817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:56.309109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] PATH_INFO: `/v3/users/4c645c645f164319bdcff7cc11989f45` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:56.310318 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c645c645f164319bdcff7cc11989f45)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:56.312583 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:56.542826 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c645c645f164319bdcff7cc11989f45'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.551965 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c645c645f164319bdcff7cc11989f45'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.636973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c645c645f164319bdcff7cc11989f45'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.637594 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c645c645f164319bdcff7cc11989f45'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.655153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c645c645f164319bdcff7cc11989f45'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:56.662124 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1417/2836] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:56 2022] DELETE /identity/v3/users/4c645c645f164319bdcff7cc11989f45 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:57.335872 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:57.338175 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:57.372980 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db740128-98ea-423a-b097-9bf5046e6466 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:57.464184 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:57.465311 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:57.465836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:57.466501 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] PATH_INFO: `/v3/projects/39fc9c155c5c41ffbb89427048cf748d` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:57.468340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fc9c155c5c41ffbb89427048cf748d)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:57.471782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:57.491151 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:57.630234 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fc9c155c5c41ffbb89427048cf748d', 'request_id': 'req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:57.645390 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fc9c155c5c41ffbb89427048cf748d', 'request_id': 'req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:57.700082 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fc9c155c5c41ffbb89427048cf748d', 'request_id': 'req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:57.713898 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] The token cache is being invalidate because project 39fc9c155c5c41ffbb89427048cf748d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:57.714183 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:57.715091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:57.716843 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1420/2837] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:57 2022] DELETE /identity/v3/projects/39fc9c155c5c41ffbb89427048cf748d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:57.721105 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:57.722817 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:57.743400 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d895a09-e1c8-4311-97f3-6187c79b533f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:57.831869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:57.832520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:57.832795 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:57.833063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] PATH_INFO: `/v3/users/45b695f8b0bf4637a8ca9bf668a1d445` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:57.834208 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b695f8b0bf4637a8ca9bf668a1d445)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:57.837628 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:58.079777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:58.092320 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b695f8b0bf4637a8ca9bf668a1d445'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.110980 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b695f8b0bf4637a8ca9bf668a1d445'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.180956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b695f8b0bf4637a8ca9bf668a1d445'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.181894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b695f8b0bf4637a8ca9bf668a1d445'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.201473 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6d7da018-3e1f-495d-96b5-ea5dd91a5908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b695f8b0bf4637a8ca9bf668a1d445'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.208089 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1418/2838] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:32:57 2022] DELETE /identity/v3/users/45b695f8b0bf4637a8ca9bf668a1d445 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:32:58.710417 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:58.713098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:58.731973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc8e89-5c80-469c-8173-ad19c76e0dfa admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:58.802047 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:58.802686 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:58.802959 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:58.803368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] PATH_INFO: `/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:58.806779 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b4d8e39cd641cb812ace6b5dec74bb)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:58.808778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:58.964904 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b4d8e39cd641cb812ace6b5dec74bb', 'request_id': 'req-237c29a9-737b-40d8-b255-62d36901f3a9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:58.972243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b4d8e39cd641cb812ace6b5dec74bb', 'request_id': 'req-237c29a9-737b-40d8-b255-62d36901f3a9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:59.048574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b4d8e39cd641cb812ace6b5dec74bb', 'request_id': 'req-237c29a9-737b-40d8-b255-62d36901f3a9'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:59.066951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] The token cache is being invalidate because project a0b4d8e39cd641cb812ace6b5dec74bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:32:59.067749 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:59.069360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-237c29a9-737b-40d8-b255-62d36901f3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:32:59.076842 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1421/2839] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:32:58 2022] DELETE /identity/v3/projects/a0b4d8e39cd641cb812ace6b5dec74bb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:59.081494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.081494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.081494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.102849 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:59.104500 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:59.197552 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1419/2840] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:59.205296 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.205623 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.205867 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.235033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:59.236833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:59.248062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1422/2841] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:32:59.255076 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.267067 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343dd35-06e0-4c2b-ade0-dac6ba89679f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.275685 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.276654 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.277258 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.277590 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.278390 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:32:59.278839 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.281341 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.304504 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1420/2842] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:32:59.306644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.326006 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256582-9fd0-4739-a323-d9b72ea0b4d8 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.334811 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.335742 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.336281 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.336643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.338514 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.341601 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.430139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1423/2843] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:32:59 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:59.434927 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.446706 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9599be-e381-4f34-bc1b-285ca476d2b5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.520252 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.520865 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.521141 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.521405 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.522175 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.524174 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.604978 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1421/2844] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:32:59 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:32:59.609606 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.615152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:59.622526 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85036b9f-416b-46e8-a358-061c2f467732 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.627598 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.628243 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.628516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.628780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.629539 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.631069 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.650777 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1424/2845] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:32:59.652242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.665767 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb50eb-2a57-4fee-aa53-fe245d166e73 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.674819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.675643 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.676064 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.676399 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.677254 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.679987 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4c4f5-312e-4553-bc1e-12bd3ee9c1c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.695046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1422/2846] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:32:59.699856 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.711165 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54da22-9616-4a25-a4a0-69a54e9f09a1 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:32:59.716212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:32:59.717253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.717782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.718386 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] PATH_INFO: `/v3/projects/3db57c72694f4097879b6a3065f11144/users/b0718d78fdc5490f92d8aaabb1fb39f5/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.738083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db57c72694f4097879b6a3065f11144, user_id=b0718d78fdc5490f92d8aaabb1fb39f5, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:32:59.742086 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:32:59.831794 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1425/2847] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:32:59 2022] PUT /identity/v3/projects/3db57c72694f4097879b6a3065f11144/users/b0718d78fdc5490f92d8aaabb1fb39f5/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:32:59.832781 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d73c-4f33-42dc-af00-fc87301236ad None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:32:59.833055 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d73c-4f33-42dc-af00-fc87301236ad None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:32:59.833328 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d73c-4f33-42dc-af00-fc87301236ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:32:59.857257 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8be6d73c-4f33-42dc-af00-fc87301236ad None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:32:59.858543 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8be6d73c-4f33-42dc-af00-fc87301236ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:32:59.879236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:32:59.924554 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1423/2848] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:32:59.934764 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:32:59.937896 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:00.000387 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01d7a-751c-4cbc-82e2-8f3b628dd059 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:00.004231 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:00.004844 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:00.005145 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:00.005440 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:00.016668 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:00.018195 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:00.029014 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1426/2849] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:01.824057 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461b4ff-28d4-4664-8fca-cd304e1ef71f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:01.825017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461b4ff-28d4-4664-8fca-cd304e1ef71f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:01.825017 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461b4ff-28d4-4664-8fca-cd304e1ef71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:01.894043 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a461b4ff-28d4-4664-8fca-cd304e1ef71f None None] MFA Rules not processed for user `b0718d78fdc5490f92d8aaabb1fb39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:01.895931 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a461b4ff-28d4-4664-8fca-cd304e1ef71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:02.023966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1424/2850] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:02.034510 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:02.037154 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:02.116882 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eb5-ccd4-4e00-9a8d-580742480093 service neutron] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:02.121173 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:02.122350 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:02.122604 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:02.122908 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:02.137474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:02.139465 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061aeef-0448-4cb0-985f-620c898fcf3c service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:02.151291 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1427/2851] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:05.020520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:05.021087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:05.021559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:05.048736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] MFA Rules not processed for user `b0718d78fdc5490f92d8aaabb1fb39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:05.050139 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:05.058697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1425/2852] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:08.767282 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:08.767818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:08.767945 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:08.788829 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] MFA Rules not processed for user `18ea29f7742647d1b83dc7d5c6b6e054`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:08.791152 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:08.852565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1428/2853] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 18:33:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:08.868214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:08.868214 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:08.937081 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffa3f-855c-4810-825d-b5b7e9d810a6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:08.942582 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab64f273e7554c40b7d7eac5f59eb3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:08.943222 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:08.944242 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:08.944511 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:08.953467 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:08.955088 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:08.965687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1426/2854] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 18:33:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 18:33:12.115912 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:12.117389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:12.139116 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8e9ce-9d4d-4bec-9de7-7164effec5c4 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:12.147956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:12.147956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:12.147956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:12.147956 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] PATH_INFO: `/v3/users/8c8bf9f97fd64ec8b1e4a2d72e583fab` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:12.148361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8bf9f97fd64ec8b1e4a2d72e583fab)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:12.149432 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:12.163999 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:12.318821 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8bf9f97fd64ec8b1e4a2d72e583fab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.425029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8bf9f97fd64ec8b1e4a2d72e583fab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.437498 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8bf9f97fd64ec8b1e4a2d72e583fab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.438139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8bf9f97fd64ec8b1e4a2d72e583fab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.438820 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-4d5d19fd-e5c8-40be-8782-26baa9c20410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8bf9f97fd64ec8b1e4a2d72e583fab'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.453137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1429/2855] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:33:12 2022] DELETE /identity/v3/users/8c8bf9f97fd64ec8b1e4a2d72e583fab => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:12.747946 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:12.761437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b97b-643c-48ea-9c34-9fa7353844c5 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:12.795580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:12.819777 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:12.820426 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:12.820703 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:12.820971 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] PATH_INFO: `/v3/projects/e89a3d059b2b4321b16fd68d921ddfcb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:12.822085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89a3d059b2b4321b16fd68d921ddfcb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:12.824087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:12.943832 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89a3d059b2b4321b16fd68d921ddfcb', 'request_id': 'req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:12.946714 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89a3d059b2b4321b16fd68d921ddfcb', 'request_id': 'req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:13.024929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89a3d059b2b4321b16fd68d921ddfcb', 'request_id': 'req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:13.035941 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] The token cache is being invalidate because project e89a3d059b2b4321b16fd68d921ddfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:33:13.036227 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:13.037047 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-18d1b274-abbe-46ea-b506-b3cbfda3ac0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:13.038522 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1427/2856] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:33:12 2022] DELETE /identity/v3/projects/e89a3d059b2b4321b16fd68d921ddfcb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:13.043734 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.044249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.044627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.066046 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:13.067263 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:13.127871 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1430/2857] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:13.134869 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.135146 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.135413 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.154741 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:13.155966 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:13.164382 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1428/2858] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:13.168832 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.178568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b28f4-73b2-4401-82d7-cd8e97ad176b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.183918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.190235 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.199419 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1431/2859] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:33:13.203697 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.213416 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390759-2499-4f15-88ec-3b4783bdce6e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.218011 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.218611 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.218885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.219151 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.219796 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.221701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.306870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1429/2860] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:33:13 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:33:13.312003 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.326450 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f2a1b-f268-47f9-932f-52a49c41b2c8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.385735 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.386327 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.386600 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.386866 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.387482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.389429 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.448034 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1432/2861] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:33:13 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:33:13.452250 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.463369 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dff24-5fb3-4a9e-ba36-f8dfc857d3ae admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.468027 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.468620 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.468890 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.469156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.469819 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.471403 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.481555 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1430/2862] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:33:13.485482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.495310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c7ff3-66bc-49fb-a22a-b1022361f099 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.499899 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.500747 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.501043 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.501309 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.501954 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.503545 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65fa55-0c93-43ef-b579-15e31d5b087e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.504791 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:13.515360 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1433/2863] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:33:13.519572 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.530106 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012373d8-4135-4f3d-8bc4-51ef5c475e14 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.534715 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.535361 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.535637 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.535936 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] PATH_INFO: `/v3/projects/e6dac26870be43aea7cb44f8322a6298/users/4f2945894abb4c0e8ebadd8a3a5f59c2/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.550533 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dac26870be43aea7cb44f8322a6298, user_id=4f2945894abb4c0e8ebadd8a3a5f59c2, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.553238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.607964 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1431/2864] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:33:13 2022] PUT /identity/v3/projects/e6dac26870be43aea7cb44f8322a6298/users/4f2945894abb4c0e8ebadd8a3a5f59c2/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:13.618424 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.618705 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.618972 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.650555 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] MFA Rules not processed for user `4f2945894abb4c0e8ebadd8a3a5f59c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:13.651828 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:13.716039 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1434/2865] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:13.727145 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:13.728888 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:13.785461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f11c-33c8-44f6-ba25-9b451054201d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:13.789686 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:13.790278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:13.790549 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:13.790814 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:13.799044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:13.800495 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cc413-0096-4b10-9761-1e02002c3233 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:13.809269 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1432/2866] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:16.784721 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:16.866586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82cf01-3102-4a6c-84ca-b7d752367f5f None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:16.871420 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:16.872084 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:16.872365 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:16.872637 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] PATH_INFO: `/v3/users/4f2945894abb4c0e8ebadd8a3a5f59c2` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:16.875153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2945894abb4c0e8ebadd8a3a5f59c2)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:16.876463 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:17.128717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2945894abb4c0e8ebadd8a3a5f59c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:17.224546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2945894abb4c0e8ebadd8a3a5f59c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:17.242934 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2945894abb4c0e8ebadd8a3a5f59c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:17.243951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2945894abb4c0e8ebadd8a3a5f59c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:17.244573 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2945894abb4c0e8ebadd8a3a5f59c2'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:17.259840 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1435/2867] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:33:16 2022] DELETE /identity/v3/users/4f2945894abb4c0e8ebadd8a3a5f59c2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:17.264409 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:17.264934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:17.264934 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:17.273979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:17.285278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:17.286490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:17.348573 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1433/2868] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:17.358715 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:17.360266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:17.369260 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:17.423340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033b4cd-8467-4820-8160-b3de275c00cc admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:17.427251 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:17.427918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:17.428192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:17.428456 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:17.438437 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:17.439951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e18f7-dacd-45b7-83d4-ced1e2be009b service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:17.450230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1436/2869] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:17.841107 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:17.842530 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:17.858580 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594751-b77f-48f2-b408-eeff90b2f820 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:17.863702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:17.864377 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:17.864655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:17.864961 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] PATH_INFO: `/v3/projects/e6dac26870be43aea7cb44f8322a6298` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:17.874018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6dac26870be43aea7cb44f8322a6298)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:17.874018 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.006429 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6dac26870be43aea7cb44f8322a6298', 'request_id': 'req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:18.017100 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6dac26870be43aea7cb44f8322a6298', 'request_id': 'req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:18.076615 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6dac26870be43aea7cb44f8322a6298', 'request_id': 'req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:18.089357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] The token cache is being invalidate because project e6dac26870be43aea7cb44f8322a6298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:33:18.091389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:18.091389 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fd607b3-7bf8-4673-a5fe-0f69f8cd7681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:33:18.091799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1434/2870] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:33:17 2022] DELETE /identity/v3/projects/e6dac26870be43aea7cb44f8322a6298 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:18.096671 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.097157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.097277 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.124643 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:18.126126 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:18.189062 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1437/2871] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:18.254678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.254955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.255231 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.277156 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:18.280234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:18.286483 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1435/2872] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:33:18.291635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.302885 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9795a83-3a31-45d3-82bc-10a6627e829b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.307642 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.308293 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.308646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.308909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.309563 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:33:18.309863 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.311485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.324076 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1438/2873] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:33:18.328652 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.340928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5aae1-a008-4c4a-b73a-3ae4450a4734 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.345739 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.346350 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.346629 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.346900 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.347520 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.349531 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.439857 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1436/2874] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:33:18 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:33:18.444948 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.457121 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851ac24-da40-48db-875e-1a7c8a518ba3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.517483 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.517998 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.518299 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.518568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.519198 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.521164 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.631736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1439/2875] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:33:18 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 18:33:18.637086 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.648147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f1b-6379-4637-a6bc-2d62fb06fb6b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.653698 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.654304 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.659259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.659259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.659259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.659259 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.667501 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1437/2876] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 18:33:18.671932 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.682901 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6fc21-8756-439f-8ff1-4a91bb656c0a admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.687973 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.688591 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.688869 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.689139 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.689782 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.691397 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913f78b-7600-45d8-b3ff-05338c2eeeba admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.704290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1440/2877] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:33:18.708655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.719464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6bb79-1934-4f39-aa70-51bbd31ec13c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:18.724479 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:18.724949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.725229 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.725625 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] PATH_INFO: `/v3/projects/9eca92132f6241428b70435ba162dc89/users/01e57f6ef2da45428fcd1956e1042a8e/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.744373 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eca92132f6241428b70435ba162dc89, user_id=01e57f6ef2da45428fcd1956e1042a8e, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:18.747099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:18.843559 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1438/2878] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:33:18 2022] PUT /identity/v3/projects/9eca92132f6241428b70435ba162dc89/users/01e57f6ef2da45428fcd1956e1042a8e/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:33:18.854586 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848d2-6d6f-4ba6-8cdc-06a4d78ab638 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:18.854895 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848d2-6d6f-4ba6-8cdc-06a4d78ab638 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:18.855157 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848d2-6d6f-4ba6-8cdc-06a4d78ab638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:18.883137 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:18.888991 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-859848d2-6d6f-4ba6-8cdc-06a4d78ab638 None None] MFA Rules not processed for user `01e57f6ef2da45428fcd1956e1042a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:18.890253 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-859848d2-6d6f-4ba6-8cdc-06a4d78ab638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:18.959132 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1441/2879] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:33:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:18.973437 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:18.977153 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:19.004591 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:19.040949 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a284-7f8f-49ad-a35a-56603c750097 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:19.044414 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:19.045169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:19.045391 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:19.045705 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:19.055052 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:19.057147 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:19.066518 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1439/2880] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:29.030758 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=26 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:29.134188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=15 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:33:46.446681 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6a56-0cd3-4812-b57e-816eb5989ff1 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:46.447301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6a56-0cd3-4812-b57e-816eb5989ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:46.447301 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6a56-0cd3-4812-b57e-816eb5989ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:46.468725 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-b87c6a56-0cd3-4812-b57e-816eb5989ff1 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:46.469939 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-b87c6a56-0cd3-4812-b57e-816eb5989ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:46.541546 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1442/2881] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:46.569870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:46.572299 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:46.654238 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56678-fc6d-4582-b2ba-9afe176a6864 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:46.660056 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:46.660676 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:46.661001 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:46.661277 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:46.670974 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:46.672670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:46.683301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1440/2882] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:33:52.108626 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f59d-2dc1-4740-95d6-f29f152c6ac9 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:52.109153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f59d-2dc1-4740-95d6-f29f152c6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:52.109153 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2f59d-2dc1-4740-95d6-f29f152c6ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:52.134368 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-91c2f59d-2dc1-4740-95d6-f29f152c6ac9 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:52.135404 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-91c2f59d-2dc1-4740-95d6-f29f152c6ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:52.156401 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1443/2883] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:52.181627 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:52.183121 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:52.197702 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28895cb-5cc7-4a91-84e2-d40f3b1d59bc service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:52.203278 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:52.203903 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:52.204181 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:52.204450 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:52.212727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:52.214303 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:52.223954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1441/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:33:58.681444 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ba1f-63d4-464b-b4a1-761d992d97f5 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:58.681997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ba1f-63d4-464b-b4a1-761d992d97f5 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:58.681997 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718ba1f-63d4-464b-b4a1-761d992d97f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:58.703114 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8718ba1f-63d4-464b-b4a1-761d992d97f5 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:33:58.704338 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8718ba1f-63d4-464b-b4a1-761d992d97f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:33:58.720289 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1444/2885] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:33:58.736673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:33:58.749193 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d228bb-df99-49ff-9835-2c86bb4f5ad7 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:33:58.755491 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:33:58.756240 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:33:58.761169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:33:58.762301 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:33:58.772490 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:33:58.774125 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:33:58.784327 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1442/2886] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:03.484027 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:03.484629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:03.484629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:03.505833 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:03.507064 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:03.515101 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1445/2887] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:03.543830 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:03.555528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627b271-d9ab-404d-b351-ef3ba8d79b85 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:03.561201 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:03.561823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:03.562110 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:03.562381 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:03.571617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:03.573243 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68ffd3-f7f0-403a-9739-5f2eda58ff4a service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:03.584803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1443/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:05.626315 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:05.636831 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ef78-b190-4d73-8fc9-cd4d21d1da6b None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:05.642393 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:05.643061 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:05.643983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:05.643983 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] PATH_INFO: `/v3/users/01e57f6ef2da45428fcd1956e1042a8e` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:05.645123 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e57f6ef2da45428fcd1956e1042a8e)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:05.648766 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:05.835449 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e57f6ef2da45428fcd1956e1042a8e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:05.910529 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e57f6ef2da45428fcd1956e1042a8e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:05.923930 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e57f6ef2da45428fcd1956e1042a8e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:05.924629 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e57f6ef2da45428fcd1956e1042a8e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:05.925225 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e57f6ef2da45428fcd1956e1042a8e'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:05.938861 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1446/2889] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:34:05 2022] DELETE /identity/v3/users/01e57f6ef2da45428fcd1956e1042a8e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:34:05.943567 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:05.953228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:05.953228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:05.965009 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:05.966233 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:06.029494 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1444/2890] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:06.039574 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:06.041212 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:06.105230 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948833-8e95-4f5f-9566-9d3cd91c8fe8 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:06.109200 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:06.109892 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:06.110348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:06.110622 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:06.117893 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:06.120194 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:06.121778 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e5c04-d659-47c9-92b9-e0b02ecb6120 service neutron] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:06.132172 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1447/2891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:06.529251 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:06.530687 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:06.550090 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a071-a36b-4032-9e18-b35fe3aba300 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:06.559488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:06.564371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:06.564371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:06.564371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] PATH_INFO: `/v3/projects/9eca92132f6241428b70435ba162dc89` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:06.564371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eca92132f6241428b70435ba162dc89)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:06.564371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:06.716783 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:06.722720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eca92132f6241428b70435ba162dc89', 'request_id': 'req-faa792a6-af49-49fa-ac28-b35b736f977e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:06.728809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eca92132f6241428b70435ba162dc89', 'request_id': 'req-faa792a6-af49-49fa-ac28-b35b736f977e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:06.830701 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eca92132f6241428b70435ba162dc89', 'request_id': 'req-faa792a6-af49-49fa-ac28-b35b736f977e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:06.842604 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] The token cache is being invalidate because project 9eca92132f6241428b70435ba162dc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:34:06.842930 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:06.843592 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-faa792a6-af49-49fa-ac28-b35b736f977e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:06.845358 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1445/2892] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:34:06 2022] DELETE /identity/v3/projects/9eca92132f6241428b70435ba162dc89 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:34:06.850666 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:06.851216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:06.851216 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:06.873142 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:06.874358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:06.936755 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1448/2893] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:06.945455 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:06.945993 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:06.946220 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:06.966384 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:06.967940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:06.975969 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1446/2894] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:06.980271 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:06.996459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378d4ee-12a3-41b3-a270-3f623d5b0e7c None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.005029 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.005753 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.006026 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.006345 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.007023 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 18:34:07.007380 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.009138 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.021547 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1449/2895] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 18:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 18:34:07.026046 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.035870 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b85e2-0301-4a2b-8d2a-a1c25a874333 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.040828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.041661 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.041940 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.042224 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.042860 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.044835 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.136330 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1447/2896] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 18:34:07 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:34:07.140787 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.151310 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c523a2-f52e-4549-8509-d0d6a7db8bc3 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.209208 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.209813 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.210091 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.210361 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] PATH_INFO: `/v3/users` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.210982 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.212947 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.328329 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1450/2897] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 18:34:07 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 18:34:07.332528 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.342986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193dd4f-ffff-4ff1-9379-33188656ea0b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.348265 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.348872 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.349150 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.349419 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.350053 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.351650 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.363236 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1448/2898] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:34:07.368228 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.379097 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa55a3-b975-4c0b-9272-98a4d596d55e admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.384290 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.384953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.385353 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.385652 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.386266 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.388005 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b320a-75e6-4f0e-b62f-224154596857 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.398927 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1451/2899] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 18:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 18:34:07.403408 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.414264 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5bb49-2750-45f6-aa4a-6772de8aea8d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.418999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.419646 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.419954 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.420228 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] PATH_INFO: `/v3/projects/70081ff6ad024844802a9d91f0e54024/users/238073ed07204c60b16dbabb6b4c2e13/roles/f6b2f10d1614446281653edfc178a15f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.435828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70081ff6ad024844802a9d91f0e54024, user_id=238073ed07204c60b16dbabb6b4c2e13, role_id=f6b2f10d1614446281653edfc178a15f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.439310 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c890204-2e3d-433e-93aa-24f7e2059107 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.648112 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1449/2900] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 18:34:07 2022] PUT /identity/v3/projects/70081ff6ad024844802a9d91f0e54024/users/238073ed07204c60b16dbabb6b4c2e13/roles/f6b2f10d1614446281653edfc178a15f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:34:07.658814 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.659141 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.659516 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.688065 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] MFA Rules not processed for user `238073ed07204c60b16dbabb6b4c2e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:07.692389 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:07.749588 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.753065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.753065 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.753331 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:07.769580 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1452/2901] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:07.771083 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:07.772357 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:07.780226 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.783736 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:07.835169 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1450/2902] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:34:07.841627 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb50c1-980a-4221-9299-94aee2b0ed94 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.846028 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.846644 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.846920 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.847190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.856940 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.858474 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514393f8-78ea-403c-b041-1d7a08cdd155 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.860283 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:07.861973 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:07.868149 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1453/2903] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:34:07.934314 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:07.939678 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb94c6-3583-4189-814d-5a5e0ad063de None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:07.945550 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:07.946176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:07.946424 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:07.946693 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:07.957246 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:07.958893 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:07.968662 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1451/2904] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:12.057765 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:12.058403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:12.058403 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:12.079700 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:12.080877 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:12.089020 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1454/2905] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:12.114187 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:12.115937 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:12.136270 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58930d2-ca56-450e-b5eb-942ba3c30733 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:12.142436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:12.144078 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:12.144556 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:12.144837 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:12.155297 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:12.165800 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:12.177063 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1452/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 18:34:18.200916 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:18.202402 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:18.284850 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561319-1e4f-4109-8a46-5471ecc9ac59 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:18.290792 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:18.291412 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:18.291836 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:18.292098 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:18.293987 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:18.308619 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:18.316634 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1392a-4395-4a8a-9d1c-42fe7e89103f service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:18.324519 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1455/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:19.775956 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:19.788481 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbe52-b23a-4010-879e-bf462d4e4fbe service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:19.793281 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:19.793910 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:19.794185 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:19.794453 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] PATH_INFO: `/v3/users/238073ed07204c60b16dbabb6b4c2e13` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:19.795803 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238073ed07204c60b16dbabb6b4c2e13)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:19.797731 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:20.034293 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238073ed07204c60b16dbabb6b4c2e13'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:20.041986 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238073ed07204c60b16dbabb6b4c2e13'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:20.149994 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238073ed07204c60b16dbabb6b4c2e13'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:20.150617 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238073ed07204c60b16dbabb6b4c2e13'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:20.164062 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238073ed07204c60b16dbabb6b4c2e13'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:20.170506 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1453/2908] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:34:19 2022] DELETE /identity/v3/users/238073ed07204c60b16dbabb6b4c2e13 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:34:20.175717 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:20.176249 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:20.176348 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:20.196953 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:20.198190 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:20.260342 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1456/2909] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:20.270140 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:20.271642 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:20.331315 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798609-2ca1-422d-a768-f6a2310620d9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:20.334855 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:20.335457 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:20.335727 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:20.336028 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:20.346015 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:20.347505 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8797c-0df8-41e0-a6fe-be0af41b0c78 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:20.358913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1454/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:20.849107 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:20.851340 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:20.869728 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca27dcd-66f5-4daf-adfa-ae68bc1ec7ab None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:20.875127 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:20.875578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:20.876193 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:20.876413 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] PATH_INFO: `/v3/projects/70081ff6ad024844802a9d91f0e54024` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:20.877565 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70081ff6ad024844802a9d91f0e54024)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:20.879597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:20.898430 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=100 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:20.997819 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70081ff6ad024844802a9d91f0e54024', 'request_id': 'req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:21.004837 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70081ff6ad024844802a9d91f0e54024', 'request_id': 'req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:21.081341 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70081ff6ad024844802a9d91f0e54024', 'request_id': 'req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:21.093568 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] The token cache is being invalidate because project 70081ff6ad024844802a9d91f0e54024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:34:21.093855 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:21.094500 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-dab0aa85-7006-4c82-9fcc-ce1a70cffb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:34:21.096113 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1457/2911] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:34:20 2022] DELETE /identity/v3/projects/70081ff6ad024844802a9d91f0e54024 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:34:30.354026 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:30.602763 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:30.603044 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:30.603317 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:30.622630 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] MFA Rules not processed for user `b0718d78fdc5490f92d8aaabb1fb39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:30.623868 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:30.677955 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1455/2912] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 18:34:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:31.090135 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:40.671462 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=25 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:34:53.298628 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5556ec-0f53-4cd6-a8b2-5fe857e26f64 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:53.299223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5556ec-0f53-4cd6-a8b2-5fe857e26f64 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:53.299223 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5556ec-0f53-4cd6-a8b2-5fe857e26f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:53.318597 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-2b5556ec-0f53-4cd6-a8b2-5fe857e26f64 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:53.319825 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-2b5556ec-0f53-4cd6-a8b2-5fe857e26f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:53.378307 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1458/2913] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:53.399913 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:53.401673 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:53.473886 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae778541-ea6f-4158-8d58-d8ccf99570a9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:53.480021 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:53.480622 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:53.480894 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:53.481164 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:53.489234 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:53.490744 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:53.500170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1456/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:34:57.754810 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a404a-26de-488d-a198-70049caf352e None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:57.755504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a404a-26de-488d-a198-70049caf352e None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:57.755504 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a404a-26de-488d-a198-70049caf352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:57.775578 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-dd4a404a-26de-488d-a198-70049caf352e None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:34:57.777192 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-dd4a404a-26de-488d-a198-70049caf352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:57.784937 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1459/2915] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:34:57.806601 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:34:57.808962 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:34:57.824097 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7caa-a0d1-4ec4-8343-9f8f30fd1d33 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:34:57.829597 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:34:57.830188 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:34:57.830461 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:34:57.830736 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:34:57.838929 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:34:57.840953 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:34:57.850294 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1457/2916] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:00.700687 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d371-8bea-4ec9-814f-5986e23b9703 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:00.701317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d371-8bea-4ec9-814f-5986e23b9703 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:00.701317 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d371-8bea-4ec9-814f-5986e23b9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:00.721577 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-3433d371-8bea-4ec9-814f-5986e23b9703 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:35:00.722773 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-3433d371-8bea-4ec9-814f-5986e23b9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:00.731031 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1460/2917] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 18:35:00.754272 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:00.766286 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808849-06ec-4474-bec4-148361e1a6fc service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:00.771688 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:00.772436 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:00.772730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:00.772999 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:00.782099 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:00.783664 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:00.793263 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1458/2918] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:04.991308 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e936-9c12-493c-9732-1c743a2ddb15 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:04.991929 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e936-9c12-493c-9732-1c743a2ddb15 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:04.992044 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e936-9c12-493c-9732-1c743a2ddb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:05.012609 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-d7c1e936-9c12-493c-9732-1c743a2ddb15 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:35:05.013724 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-d7c1e936-9c12-493c-9732-1c743a2ddb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:05.021485 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1461/2919] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:35:05.048928 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:05.060190 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a6a-0381-4034-94ff-9097ea2ee926 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:05.065655 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:05.066295 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:05.066565 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:05.066828 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:05.075109 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:05.076749 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:05.086176 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1459/2920] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:09.350021 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] REQUEST_METHOD: `POST` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:09.350631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:09.350631 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:09.370616 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.auth.core [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] MFA Rules not processed for user `57b1eaab77b840f39d5eb6bd620e915e`. Rule list: `[]` (Enabled: `True`). {{(pid=81884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 18:35:09.372394 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:09.380019 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1462/2921] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Aug 24 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 18:35:09.403085 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:09.414410 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaed36-b278-4f9d-975c-3269b4a08757 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:09.420532 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66707e00ece419d9cc33f09ba016e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:09.421128 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:09.421402 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:09.421670 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:09.430464 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:09.432087 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:09.441755 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1460/2922] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:13.470774 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:13.472435 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:13.540738 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fed96-ced6-450f-999b-4a263b0ff617 None None] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:13.544354 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a4fb108a9e6494f8465dc2e86911ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:13.544951 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:13.545224 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:13.545488 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:13.547288 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:13.560918 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:13.562376 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:13.573370 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1463/2923] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:35:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:17.596235 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:17.597730 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:17.661488 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab822a8-3b2d-4429-8f4c-d30be365fd23 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:17.665192 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c637175771de4971a667a9687cfb7e3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:17.665799 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:17.666075 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:17.666345 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:17.668709 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:17.684326 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:17.685874 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:17.698059 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1461/2924] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:35:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:35:23.568358 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=65 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:35:27.692747 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:35:46.045909 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:46.047646 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:35:46.061676 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b44ae-7d95-43a7-aaf3-f09c78b5e781 service cinder] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:46.066181 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:46.066807 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:46.067083 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:46.067459 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] PATH_INFO: `/v3/users/b0718d78fdc5490f92d8aaabb1fb39f5` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:46.068635 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0718d78fdc5490f92d8aaabb1fb39f5)` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:46.070560 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:46.253494 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0718d78fdc5490f92d8aaabb1fb39f5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.337618 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0718d78fdc5490f92d8aaabb1fb39f5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.351102 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0718d78fdc5490f92d8aaabb1fb39f5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.351818 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0718d78fdc5490f92d8aaabb1fb39f5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.352421 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.notifications [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0718d78fdc5490f92d8aaabb1fb39f5'} {{(pid=81884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.365267 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1464/2925] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 18:35:46 2022] DELETE /identity/v3/users/b0718d78fdc5490f92d8aaabb1fb39f5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 18:35:46.596809 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:35:46.608717 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45cc9a-453b-44c1-be46-bcdd10795003 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:35:46.667247 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b1eaab77b840f39d5eb6bd620e915e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2824d75c5b514c0dacffd09ee4e2eb05', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:35:46.667823 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:35:46.668103 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:35:46.668371 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] PATH_INFO: `/v3/projects/3db57c72694f4097879b6a3065f11144` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:35:46.669476 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db57c72694f4097879b6a3065f11144)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:35:46.671380 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:35:46.775720 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db57c72694f4097879b6a3065f11144', 'request_id': 'req-57e016cb-9852-42f2-9beb-9f81397df6d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.781885 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db57c72694f4097879b6a3065f11144', 'request_id': 'req-57e016cb-9852-42f2-9beb-9f81397df6d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.828585 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db57c72694f4097879b6a3065f11144', 'request_id': 'req-57e016cb-9852-42f2-9beb-9f81397df6d3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.839290 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] The token cache is being invalidate because project 3db57c72694f4097879b6a3065f11144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 18:35:46.841557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.841557 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-57e016cb-9852-42f2-9beb-9f81397df6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 18:35:46.842979 dv-cinder-840525-3-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1462/2926] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 18:35:46 2022] DELETE /identity/v3/projects/3db57c72694f4097879b6a3065f11144 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 18:35:56.361158 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:35:56.836170 dv-cinder-840525-3-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 18:39:23.159780 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Authenticating user token {{(pid=81884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 18:39:23.162283 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:39:23.306482 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536882-cc78-4258-87d1-37e07469fc12 admin admin] Validating token access rules against request {{(pid=81884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 18:39:23.367105 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48609f3d5dd94c5a9cf3fc0e18bf0aa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4939c9fe262467bbc01da9f6a974f75', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 18:39:23.367704 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] REQUEST_METHOD: `GET` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 18:39:23.368038 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] SCRIPT_NAME: `/identity` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 18:39:23.368304 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 18:39:23.370033 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.fernet_utils [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 18:39:23.382702 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 18:39:23.384245 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2055a5-efb1-481a-a4b4-16f9ff3e617c service placement] RBAC: Authorization granted {{(pid=81884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 18:39:23.395647 dv-cinder-840525-3-smb devstack@keystone.service[81884]: [pid: 81884|app: 0|req: 1465/2927] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 18:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 18:39:33.391375 dv-cinder-840525-3-smb devstack@keystone.service[81884]: DEBUG dbcounter [-] [81884] Writing DB stats keystone:SELECT=89 {{(pid=81884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}